00000001:02000400:0.0F:1790100200.231448:0:2969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1790100215.170729:0:3189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1790100216.890390:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 939 MB/s 00000001:01000000:3.0:1790100217.140189:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 935 MB/s 00000001:01000000:2.0:1790100217.389702:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6547 MB/s 00000020:02000000:2.0:1790100217.906835:0:3280:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_63_g8caac7f 00000400:02000000:3.0:1790100218.938856:0:3295:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.118@tcp [8/256/0/180] 00008000:02000000:0.0:1790100222.412379:0:3445:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1790100267.458596:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1790100275.435527:0:5823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790100275.435535:0:5823:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1790100275.435975:0:5823:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000090ca07ac 00000080:02000400:0.0:1790100275.435992:0:5823:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1790100275.439582:0:5823:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1790100275.439595:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790100275.439970:0:5823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000082650c7) 00000020:00000080:0.0:1790100275.439988:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790100275.457054:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1790100275.457605:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1790100275.479468:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1790100275.479512:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790100275.479535:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1790100275.479587:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790100275.479854:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1790100275.481062:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790100275.481071:0:5823:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790100275.481082:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefcbc1 00000020:01000004:1.0:1790100275.481090:0:5823:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1790100275.481095:0:5823:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790100275.481099:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000090ca07ac from MGS 00000020:01000004:1.0:1790100275.481103:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790100275.481131:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c01c8e09) 00000020:00000080:1.0:1790100275.481143:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790100275.481309:0:5823:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000090ca07ac from MGS, refs=2 00080000:01000000:1.0:1790100275.481315:0:5823:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790100275.481320:0:5823:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefcbcf 00000100:00100000:1.0:1790100275.481419:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790100275.481564:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790100275.481570:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790100275.482475:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790100275.482484:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790100275.483405:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100275.483586:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790100275.483592:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790100275.484403:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790100275.484411:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790100275.484763:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790100275.484769:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790100275.485521:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100275.485525:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100275.485527:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100275.485865:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100275.485867:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100275.485869:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100275.486531:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790100275.487845:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1790100275.735769:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4151 MB/s 00000001:01000000:0.0:1790100275.985758:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4759 MB/s 00000001:01000000:2.0:1790100276.236641:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 776 MB/s 00000001:01000000:3.0:1790100276.491697:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 913 MB/s 00080000:10000000:2.0:1790100276.500943:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1790100276.518139:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790100276.519742:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790100276.519759:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790100276.519762:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790100276.521029:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790100276.521116:0:5823:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790100276.521170:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1790100276.521396:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790100276.521422:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790100276.521811:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100276.521978:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790100276.521984:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790100276.524717:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790100276.524730:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790100276.525652:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790100276.525660:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790100276.526996:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790100276.527027:0:5823:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.118@tcp' 00000020:01000004:1.0:1790100276.527030:0:5823:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1790100276.527246:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1790100276.527493:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.118@tcp (typ=mgc) 00000020:00000080:1.0:1790100276.527505:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.118@tcp (000000003703ec04) 00000020:00000080:1.0:1790100276.527529:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790100276.527637:0:5823:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000053f0aac6@MGC192.168.201.118@tcp: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1790100276.527803:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.118@tcp-0 is initialized 00000040:01000000:1.0:1790100276.527809:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 1 is initialized 10000000:01000000:1.0:1790100276.530323:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790100276.531909:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.118@tcp (uuid 44df9276-3139-4fbb-af61-ceba3e95d22a) 00000020:00000080:2.0:1790100276.531946:0:5823:0:(genops.c:1384:class_connect()) connect: client 44df9276-3139-4fbb-af61-ceba3e95d22a, cookie 0x31a8f3fdeeefcbdd 00000100:00080000:2.0:1790100276.531960:0:5823:0:(import.c:545:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790100276.532210:0:5823:0:(import.c:666:import_select_connection()) MGC192.168.201.118@tcp: import 0000000053f0aac6 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1790100276.532253:0:5823:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002b59ebb6 x1877056126189696/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790100276.532284:0:5823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS 00000020:01000004:2.0:1790100276.532318:0:5823:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790100276.532324:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790100276.532345:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000021994c92) 00000020:00000080:2.0:1790100276.532358:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790100276.533424:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b59ebb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44df9276-3139-4fbb-af61-ceba3e95d22a:3310:1877056126189696:0@lo:250: 00000100:00100000:0.0:1790100276.533502:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100276.533584:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126189696 00000100:00100000:0.0:1790100276.533591:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126189696 00000100:00100000:0.0:1790100276.533647:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100276.533653:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c619f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1877056126189696:12345-0@lo:250: 00010000:00080000:0.0:1790100276.533677:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 44df9276-3139-4fbb-af61-ceba3e95d22a@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1790100276.533700:0:5834:0:(genops.c:1384:class_connect()) connect: client 44df9276-3139-4fbb-af61-ceba3e95d22a, cookie 0x31a8f3fdeeefcbeb 00000100:00080000:0.0:1790100276.533826:0:5834:0:(import.c:65:import_set_state_nolock()) 000000000a0407d1 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100276.533877:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c619f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+5:3310:x1877056126189696:12345-0@lo:250: Request processed in 222us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100276.533884:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100276.533939:0:3310:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790100276.533948:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.118@tcp: connect to target with instance 0 00000100:00080000:0.0:1790100276.533954:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790100276.533959:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790100276.533962:0:3310:0:(import.c:65:import_set_state_nolock()) 0000000053f0aac6 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790100276.533976:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790100276.533985:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790100276.533994:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b59ebb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44df9276-3139-4fbb-af61-ceba3e95d22a:3310:1877056126189696:0@lo:250: 00000100:00100000:0.0:1790100276.558803:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100276.559215:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790100276.559222:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790100276.560169:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790100276.560178:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790100276.560639:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790100276.560648:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790100276.561504:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100276.561826:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790100276.561841:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790100276.563477:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790100276.563488:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790100276.605056:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100276.605321:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790100276.605328:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790100276.608995:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790100276.609009:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790100276.609827:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100276.610161:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790100276.610167:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790100276.610705:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790100276.610711:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1790100276.611243:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100276.611424:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790100276.611437:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790100276.612019:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790100276.612025:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790100276.613491:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100276.613822:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790100276.613828:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790100276.614327:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790100276.614334:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790100276.633262:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100276.633464:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790100276.633478:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790100276.634409:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790100276.634417:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790100276.635730:0:5823:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790100276.635742:0:5823:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790100276.636398:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790100276.636418:0:5823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790100276.636423:0:5823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790100276.636540:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790100276.636579:0:5823:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1790100276.636584:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790100276.636585:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790100276.636586:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100276.636587:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100276.636588:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100276.636590:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100276.636591:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100276.636592:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790100276.636594:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100276.636595:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100276.636596:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100276.636597:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100276.636600:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1790100276.636602:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100276.636603:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790100276.636604:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100276.636605:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100276.636606:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100276.636607:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100276.636675:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100276.636677:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790100276.636677:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100276.636678:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100276.636679:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100276.636680:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100276.636706:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790100276.636722:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d37ca23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126189824:0@lo:253: 00000100:00100000:2.0:1790100276.636802:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100276.636894:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a93c2b6b going to sleep for 11 seconds 00000100:00100000:1.0:1790100276.636985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126189824 00000100:00100000:1.0:1790100276.636993:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126189824 00000100:00100000:1.0:1790100276.637077:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100276.637085:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000045b96c52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+5:5823:x1877056126189824:12345-0@lo:253: 20000000:01000000:1.0:1790100276.637129:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790100276.637133:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1790100276.637410:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790100276.637466:0:5836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1790100276.637762:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100276.638840:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1790100276.639078:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790100276.639081:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1790100276.639086:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1790100276.639089:0:5836:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1790100276.639100:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1790100276.639272:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100276.639496:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1790100276.639510:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790100276.639558:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1790100276.639607:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1790100276.639754:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1790100276.639834:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1790100276.639843:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1790100276.639897:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1790100276.639906:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1790100276.639952:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1790100276.639960:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1790100276.639990:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1790100276.640033:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1790100276.640059:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790100276.640063:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1790100276.640073:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100276.640261:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1790100276.640270:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790100276.640309:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1790100276.640343:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1790100276.640405:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1790100276.640417:0:5836:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1790100276.640482:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1790100276.640490:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790100276.640530:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1790100276.640563:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1790100276.640595:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1790100276.640605:0:5836:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1790100276.641121:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1790100276.641131:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1790100276.641165:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1790100276.641200:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1790100276.641365:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1790100276.641410:0:5836:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1790100276.641418:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1790100276.641852:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1790100276.642092:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1790100276.642111:0:5836:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.118@tcp for mdt 20000000:01000000:1.0:1790100276.642113:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:1.0:1790100276.642148:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1790100276.642155:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1790100276.642184:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1790100276.642191:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:1.0:1790100276.642235:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1790100276.642245:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1790100276.642278:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1790100276.642312:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1790100276.642368:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790100276.642372:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790100276.642375:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790100276.642396:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790100276.642399:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790100276.642427:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790100276.642430:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790100276.643514:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1790100276.643878:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1790100276.643930:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1790100276.644014:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1790100276.644027:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790100276.644030:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790100276.644342:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1790100276.644560:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1790100276.644602:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1790100276.644861:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1790100276.644876:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790100276.644878:0:5836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1790100276.644883:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790100276.644885:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790100276.644890:0:5836:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1790100276.644896:0:5836:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790100276.645206:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1790100276.645326:0:5836:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1790100276.651399:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1790100276.651455:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1790100276.651537:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1790100276.651559:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790100276.651586:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651606:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651656:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651682:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651689:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651695:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651701:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001fa97f8f already unused, calling callback (0000000053f73f3e) 00010000:00010000:1.0:1790100276.651705:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651711:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651722:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651729:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.651735:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001fa97f8f/0x31a8f3fdeeefcbf2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790100276.651755:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790100276.824590:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000045b96c52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+5:5823:x1877056126189824:12345-0@lo:253: Request processed in 187499us (187781us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100276.824607:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100276.824683:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d37ca23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126189824:0@lo:253: 10000000:01000000:2.0:1790100276.824697:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790100276.824703:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790100276.824705:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790100276.824706:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100276.824707:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1790100276.824709:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100276.824710:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100276.824711:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100276.824712:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790100276.824714:0:5823:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790100276.824715:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100276.824716:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790100276.824730:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000090ca07ac from lustre-MDT0000 10000000:01000000:2.0:1790100276.824750:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790100276.824752:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790100276.824756:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d6784edb380 10000000:01000000:2.0:1790100276.824759:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790100276.824765:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d6784edb380 from 1 10000000:01000000:2.0:1790100276.824767:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790100276.824798:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100276.824807:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100276.824815:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100276.824834:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d37ca23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126189952:0@lo:101: 00000100:00100000:2.0:1790100276.824871:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100276.824921:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060649c8c going to sleep for 11 seconds 00000100:00100000:0.0:1790100276.824979:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126189952 00000100:00100000:0.0:1790100276.824986:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126189952 00000100:00100000:0.0:1790100276.825054:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100276.825062:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eefb6163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+5:5823:x1877056126189952:12345-0@lo:101: 00010000:00010000:0.0:1790100276.825073:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100276.825085:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcbf9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100276.825107:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcbf9 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100276.825116:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcbf9 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100276.825125:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d60d71c9, rc 0) 00000100:00100000:0.0:1790100276.825172:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eefb6163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+6:5823:x1877056126189952:12345-0@lo:101: Request processed in 111us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100276.825178:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100276.825198:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d37ca23 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126189952:0@lo:101: 00010000:00010000:1.0:1790100276.825216:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.825224:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100276.825275:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190080:0@lo:501: 00000100:00100000:1.0:1790100276.825310:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100276.825331:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c4e759f going to sleep for 11 seconds 00000100:00100000:2.0:1790100276.825357:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126190080 00000100:00100000:2.0:1790100276.825362:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126190080 00000100:00100000:2.0:1790100276.825391:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100276.825397:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e1067a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+6:5823:x1877056126190080:12345-0@lo:501: 00000100:00100000:2.0:1790100276.825573:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e1067a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+6:5823:x1877056126190080:12345-0@lo:501: Request processed in 176us (263us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790100276.825581:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100276.825598:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190080:0@lo:501: 10000000:01000000:1.0:1790100276.825639:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790100276.825649:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.825657:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100276.825665:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d6788844800 10000000:01000000:1.0:1790100276.825668:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790100276.825671:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d6788844800 10000000:01000000:1.0:1790100276.825674:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790100276.825677:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d6788844800 from 1 10000000:01000000:1.0:1790100276.825679:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790100276.825693:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 000000001fa97f8f/0x31a8f3fdeeefcc07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.825699:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 000000001fa97f8f/0x31a8f3fdeeefcc07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.825712:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 000000001fa97f8f/0x31a8f3fdeeefcc07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100276.825720:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190208:0@lo:101: 00000100:00100000:1.0:1790100276.825738:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100276.825814:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c4e759f going to sleep for 11 seconds 00000100:00100000:3.0:1790100276.825845:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126190208 00000100:00100000:3.0:1790100276.825849:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126190208 00000100:00100000:3.0:1790100276.825878:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100276.825884:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084eb8017 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+6:5823:x1877056126190208:12345-0@lo:101: 00010000:00010000:3.0:1790100276.825891:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100276.825900:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005523c2a9/0x31a8f3fdeeefcc0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcc07 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100276.825926:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005523c2a9/0x31a8f3fdeeefcc0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc07 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100276.825933:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005523c2a9/0x31a8f3fdeeefcc0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc07 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100276.825957:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005523c2a9, rc 0) 00000100:00100000:3.0:1790100276.826024:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084eb8017 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+7:5823:x1877056126190208:12345-0@lo:101: Request processed in 141us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100276.826028:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100276.826139:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190208:0@lo:101: 00010000:00010000:1.0:1790100276.826148:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 000000001fa97f8f/0x31a8f3fdeeefcc07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.826155:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 000000001fa97f8f/0x31a8f3fdeeefcc07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100276.826165:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790100276.826178:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 000000001fa97f8f/0x31a8f3fdeeefcc07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.826184:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 000000001fa97f8f/0x31a8f3fdeeefcc07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100276.826190:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790100276.826193:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100276.826197:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d6788844800 10000000:01000000:1.0:1790100276.826200:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790100276.826202:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790100276.826205:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790100276.826216:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.826228:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.826235:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100276.826246:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190336:0@lo:101: 00000100:00100000:1.0:1790100276.826271:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100276.826291:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c4e759f going to sleep for 11 seconds 00000100:00100000:0.0:1790100276.826330:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126190336 00000100:00100000:0.0:1790100276.826338:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126190336 00000100:00100000:0.0:1790100276.826364:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100276.826369:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fcacee15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+7:5823:x1877056126190336:12345-0@lo:101: 00010000:00010000:0.0:1790100276.826376:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100276.826381:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcc15 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100276.826393:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc15 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100276.826400:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc15 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100276.826405:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c087a81e, rc 0) 00000100:00100000:0.0:1790100276.826432:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fcacee15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+8:5823:x1877056126190336:12345-0@lo:101: Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100276.826437:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790100276.826458:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190336:0@lo:101: 00010000:00010000:1.0:1790100276.826467:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100276.826474:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100276.826507:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190464:0@lo:501: 00000100:00100000:1.0:1790100276.826534:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100276.826575:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c4e759f going to sleep for 11 seconds 00000100:00100000:3.0:1790100276.826675:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126190464 00000100:00100000:3.0:1790100276.826680:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126190464 00000100:00100000:0.0:1790100276.826712:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100276.826719:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a03a67ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+8:5823:x1877056126190464:12345-0@lo:501: 00000100:00100000:1.0:1790100276.826906:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190464:0@lo:501: 00000100:00100000:0.0:1790100276.826906:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a03a67ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+9:5823:x1877056126190464:12345-0@lo:501: Request processed in 188us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100276.826923:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100276.827032:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190592:0@lo:503: 00000100:00100000:1.0:1790100276.827058:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100276.827078:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c4e759f going to sleep for 11 seconds 00000100:00100000:2.0:1790100276.827096:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126190592 00000100:00100000:2.0:1790100276.827100:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126190592 00000100:00100000:2.0:1790100276.827126:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100276.827130:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002612b58a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+9:5823:x1877056126190592:12345-0@lo:503: 00000100:00100000:2.0:1790100276.827260:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002612b58a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+9:5823:x1877056126190592:12345-0@lo:503: Request processed in 129us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100276.827266:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100276.827278:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190592:0@lo:503: 00000100:00100000:0.0:1790100276.827707:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:5864:1877056126190720:0@lo:502: 00000100:00100000:0.0:1790100276.827736:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100276.827756:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8a4aec4 going to sleep for 11 seconds 00000100:00100000:1.0:1790100276.827769:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126190720 00000100:00100000:1.0:1790100276.827778:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126190720 00000100:00100000:1.0:1790100276.827802:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100276.827807:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008716b98c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+9:5864:x1877056126190720:12345-0@lo:502: 00000100:00100000:1.0:1790100276.828056:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008716b98c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+9:5864:x1877056126190720:12345-0@lo:502: Request processed in 248us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100276.828062:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790100276.828298:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:5864:1877056126190720:0@lo:502: 00000020:01000000:0.0:1790100276.828315:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100276.828327:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100276.828329:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790100276.828334:0:5864:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790100276.828337:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100276.828347:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003b9b55c4) 00000020:00000080:0.0:1790100276.828360:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790100276.828362:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790100276.828415:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790100276.828419:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefcc2a 00000020:00000080:0.0:1790100276.828602:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790100276.828606:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100276.828608:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100276.828632:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790100276.828637:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100276.828641:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100276.828642:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790100276.828645:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100276.828651:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000570f9c85) 00000020:00000080:0.0:1790100276.828660:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790100276.828664:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790100276.828665:0:5864:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790100276.828668:0:5864:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790100276.828673:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790100276.828712:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000090ca07ac from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790100276.828722:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000262835ca) 00000020:00000080:0.0:1790100276.828727:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790100276.828768:0:5864:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790100276.828771:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefcc3f 00000020:00000080:0.0:1790100276.828829:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790100276.828833:0:5864:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790100276.828835:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x31a8f3fdeeefcc46 00080000:01000000:0.0:1790100276.828838:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790100276.828840:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefcc4d 00080000:10000000:0.0:1790100276.829383:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1790100276.829511:0:5864:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1790100276.833664:0:5864:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1790100276.902571:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1790100276.902994:0:5864:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1790100276.906178:0:5864:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1790100276.906673:0:5864:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790100276.932303:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b0a61ddd) 00000020:00000080:2.0:1790100276.932330:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790100276.932417:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790100276.932434:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefcc5b 00000020:00000080:1.0:1790100276.940249:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1790100276.941440:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790100276.964199:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790100276.982490:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790100277.001036:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790100277.043197:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790100277.076548:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1790100277.108811:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x31a8f3fdeeefcc62 00000020:00000080:3.0:1790100277.109336:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790100277.109349:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100277.109356:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100277.109358:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790100277.109361:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100277.109365:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100277.109367:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790100277.109370:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790100277.109371:0:5864:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790100277.109374:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100277.109376:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100277.109377:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790100277.109379:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100277.109384:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100277.109385:0:5864:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790100277.109389:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790100277.109442:0:5864:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1790100277.109509:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b4bd176 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:5864:1877056126190848:0@lo:502: 00000100:00100000:3.0:1790100277.109587:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100277.109655:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014927d24 going to sleep for 11 seconds 00000100:00100000:3.0:1790100277.109678:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126190848 00000100:00100000:3.0:1790100277.109685:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126190848 00000100:00100000:3.0:1790100277.109886:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100277.109895:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7228327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+9:5864:x1877056126190848:12345-0@lo:502: 00000100:00100000:3.0:1790100277.110281:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7228327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+9:5864:x1877056126190848:12345-0@lo:502: Request processed in 387us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100277.110289:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100277.110344:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b4bd176 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:5864:1877056126190848:0@lo:502: 00000020:01000000:3.0:1790100277.110369:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100277.110374:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100277.110376:0:5864:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1790100277.110381:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1790100277.111079:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1790100277.111099:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790100277.111203:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100277.111215:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100277.111223:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6788844800 from 1 10000000:01000000:1.0:1790100277.111225:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790100277.111254:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100277.111262:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100277.111270:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100277.111286:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190976:0@lo:101: 00000100:00100000:1.0:1790100277.111340:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100277.111378:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1f4c740 going to sleep for 11 seconds 00000100:00100000:2.0:1790100277.111455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126190976 00000100:00100000:2.0:1790100277.111463:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126190976 00000100:00100000:2.0:1790100277.111506:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100277.111513:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009916da0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+9:5823:x1877056126190976:12345-0@lo:101: 00010000:00010000:2.0:1790100277.111530:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100277.111543:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcc69 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100277.111562:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc69 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100277.111572:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc69 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100277.111579:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c164e21, rc 0) 00000100:00100000:2.0:1790100277.111638:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009916da0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:5823:x1877056126190976:12345-0@lo:101: Request processed in 126us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100277.111645:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790100277.111979:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126190976:0@lo:101: 00010000:00010000:1.0:1790100277.111991:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100277.112000:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100277.112674:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191104:0@lo:256: 00000100:00100000:1.0:1790100277.112973:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100277.113042:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1f4c740 going to sleep for 11 seconds 00000100:00100000:3.0:1790100277.113293:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126191104 00000100:00100000:3.0:1790100277.113302:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126191104 00000100:00100000:3.0:1790100277.113382:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100277.113391:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b7713e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+10:5823:x1877056126191104:12345-0@lo:256: 20000000:01000000:3.0:1790100277.113410:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790100277.113426:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790100277.113508:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b7713e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+10:5823:x1877056126191104:12345-0@lo:256: Request processed in 118us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100277.113515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100277.113586:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191104:0@lo:256: 10000000:01000000:1.0:1790100277.114223:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790100277.114245:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100277.114257:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100277.114266:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6788844800 from 1 10000000:01000000:1.0:1790100277.114269:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100277.114297:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100277.114304:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100277.114312:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100277.114336:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191232:0@lo:101: 00000100:00100000:1.0:1790100277.114371:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100277.115057:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1f4c740 going to sleep for 11 seconds 00000100:00100000:2.0:1790100277.115210:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126191232 00000100:00100000:2.0:1790100277.115219:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126191232 00000100:00100000:2.0:1790100277.115257:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790100277.115263:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbc50e22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:5823:x1877056126191232:12345-0@lo:101: 00010000:00010000:2.0:1790100277.115274:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100277.115286:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcc77 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100277.115304:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc77 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100277.115313:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc77 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100277.115320:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000061d4f833, rc 0) 00000100:00100000:2.0:1790100277.115376:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbc50e22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+11:5823:x1877056126191232:12345-0@lo:101: Request processed in 113us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100277.115383:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100277.115532:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191232:0@lo:101: 00010000:00010000:1.0:1790100277.115545:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100277.115553:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100277.115604:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191360:0@lo:501: 00000100:00100000:1.0:1790100277.115648:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100277.115669:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1f4c740 going to sleep for 11 seconds 00000100:00100000:2.0:1790100277.115845:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126191360 00000100:00100000:2.0:1790100277.115850:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126191360 00000100:00100000:2.0:1790100277.115868:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100277.115874:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000697cda97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+11:5823:x1877056126191360:12345-0@lo:501: 00000100:00100000:2.0:1790100277.116689:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000697cda97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+11:5823:x1877056126191360:12345-0@lo:501: Request processed in 814us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100277.116699:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790100277.117092:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191360:0@lo:501: 00000100:00100000:1.0:1790100277.117131:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191488:0@lo:503: 00000100:00100000:1.0:1790100277.117254:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100277.117310:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1f4c740 going to sleep for 11 seconds 00000100:00100000:2.0:1790100277.117352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126191488 00000100:00100000:2.0:1790100277.117359:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126191488 00000100:00100000:2.0:1790100277.117433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100277.117440:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002081d267 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+11:5823:x1877056126191488:12345-0@lo:503: 00000040:00080000:2.0:1790100277.117476:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790100277.117523:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002081d267 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+11:5823:x1877056126191488:12345-0@lo:503: Request processed in 84us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100277.117530:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790100277.117595:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000356770e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191488:0@lo:503: 00000040:00080000:1.0:1790100277.118671:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790100277.119108:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790100277.119128:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100277.119153:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.119165:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100277.119209:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790100277.119212:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d6788844800 10000000:01000000:0.0:1790100277.119215:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d6788844800 10000000:01000000:0.0:1790100277.119219:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790100277.119224:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6788844800 from 1 10000000:01000000:0.0:1790100277.119227:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790100277.119261:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.119268:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.119277:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100277.119294:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191616:0@lo:101: 00000100:00100000:0.0:1790100277.119344:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100277.119936:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad2a1dde going to sleep for 11 seconds 00000100:00100000:3.0:1790100277.120058:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126191616 00000100:00100000:3.0:1790100277.120066:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126191616 00000100:00100000:3.0:1790100277.120102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790100277.120109:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e61e5d44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+11:5823:x1877056126191616:12345-0@lo:101: 00010000:00010000:3.0:1790100277.120121:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100277.120133:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcc85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.120167:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc85 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.120187:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc85 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.120196:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078424fdb, rc 0) 00000100:00100000:3.0:1790100277.120236:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e61e5d44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5823:x1877056126191616:12345-0@lo:101: Request processed in 128us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100277.120242:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100277.120382:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191616:0@lo:101: 00010000:00010000:0.0:1790100277.120395:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.120404:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100277.120469:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191744:0@lo:501: 00000100:00100000:0.0:1790100277.120499:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100277.120525:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad2a1dde going to sleep for 11 seconds 00000100:00100000:3.0:1790100277.120655:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126191744 00000100:00100000:3.0:1790100277.120661:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126191744 00000100:00100000:3.0:1790100277.120681:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790100277.120685:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001edbf942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5823:x1877056126191744:12345-0@lo:501: 00000100:00100000:3.0:1790100277.121064:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001edbf942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5823:x1877056126191744:12345-0@lo:501: Request processed in 378us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100277.121070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790100277.121186:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191744:0@lo:501: 00000100:00100000:0.0:1790100277.121214:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191872:0@lo:503: 00000100:00100000:0.0:1790100277.121248:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100277.121275:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad2a1dde going to sleep for 11 seconds 00000100:00100000:3.0:1790100277.121375:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126191872 00000100:00100000:3.0:1790100277.121380:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126191872 00000100:00100000:3.0:1790100277.121397:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790100277.121401:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052ec9a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5823:x1877056126191872:12345-0@lo:503: 00000100:00100000:3.0:1790100277.121889:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052ec9a9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5823:x1877056126191872:12345-0@lo:503: Request processed in 486us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100277.121896:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790100277.121984:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126191872:0@lo:503: 00000100:00100000:0.0:1790100277.122351:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:5869:1877056126192000:0@lo:502: 00000100:00100000:0.0:1790100277.122390:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100277.122489:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126192000 00000100:00100000:3.0:1790100277.122494:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126192000 00000100:00100000:3.0:1790100277.122515:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790100277.122520:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000082941ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5869:x1877056126192000:12345-0@lo:502: 00000100:00100000:3.0:1790100277.122752:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000082941ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5869:x1877056126192000:12345-0@lo:502: Request processed in 232us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100277.122764:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790100277.122966:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca2e085c going to sleep for 11 seconds 00000100:00100000:0.0:1790100277.122980:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:5869:1877056126192000:0@lo:502: 00000020:01000004:0.0:1790100277.123032:0:5869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790100277.123056:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000051adf590) 00000020:00000080:0.0:1790100277.123074:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1790100277.123213:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000090ca07ac from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790100277.123217:0:5869:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000090ca07ac from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790100277.123220:0:5869:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000090ca07ac 4 00010000:00080000:0.0:1790100277.123245:0:5869:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004f6274d7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1790100277.126213:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1790100277.126487:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790100277.126522:0:5869:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790100277.126544:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x31a8f3fdeeefcc9a 00000100:00080000:0.0:1790100277.126554:0:5869:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100277.126566:0:5869:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004f6274d7 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100277.126602:0:5869:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d6406f53 x1877056126192128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100277.126663:0:5869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790100277.126961:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126192128:0@lo:38: 00000100:00100000:1.0:1790100277.127028:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100277.127347:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126192128 00000100:00100000:0.0:1790100277.127355:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126192128 00000100:00100000:0.0:1790100277.127397:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100277.127404:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000356770e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1877056126192128:12345-0@lo:38: 00000100:00100000:0.0:1790100277.127486:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000356770e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1877056126192128:12345-0@lo:38: Request processed in 81us (457us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790100277.127493:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100277.127631:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790100277.127639:0:3310:0:(import.c:65:import_set_state_nolock()) 000000004f6274d7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790100277.127642:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790100277.127655:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6406f53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126192128:0@lo:38: 00000100:00100000:0.0:1790100277.132963:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011130972 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:5869:1877056126192256:0@lo:502: 00000100:00100000:0.0:1790100277.133044:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100277.133083:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fe6f4c5 going to sleep for 11 seconds 00000100:00100000:3.0:1790100277.133133:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126192256 00000100:00100000:3.0:1790100277.133147:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126192256 00000100:00100000:3.0:1790100277.133187:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790100277.133196:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d7c61b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5869:x1877056126192256:12345-0@lo:502: 00000100:00100000:3.0:1790100277.133375:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d7c61b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5869:x1877056126192256:12345-0@lo:502: Request processed in 180us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100277.133380:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790100277.133555:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011130972 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:5869:1877056126192256:0@lo:502: 00000040:00080000:0.0:1790100277.133576:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1790100277.133682:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1790100277.133700:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790100277.133821:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100277.133833:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790100277.133875:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790100277.133877:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790100277.133879:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100277.133880:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100277.133881:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100277.133883:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100277.133884:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790100277.133885:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790100277.133886:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790100277.133887:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790100277.133889:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100277.133890:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790100277.133893:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1790100277.133895:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790100277.133896:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790100277.133898:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100277.133899:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100277.133900:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100277.133901:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100277.133902:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790100277.133915:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790100277.133916:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790100277.133917:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790100277.133918:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100277.133919:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790100277.133934:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790100277.133943:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fd7a1fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126192384:0@lo:253: 00000100:00100000:1.0:1790100277.133985:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100277.134013:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126192384 00000100:00100000:1.0:1790100277.134018:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126192384 00000100:00100000:1.0:1790100277.134043:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790100277.134049:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7a6c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5823:x1877056126192384:12345-0@lo:253: 20000000:01000000:1.0:1790100277.134069:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790100277.134083:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790100277.134666:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1f4c740 going to sleep for 11 seconds 20000000:01000000:1.0:1790100277.151358:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790100277.151375:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790100277.151386:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790100277.151391:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790100277.151409:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.151429:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc69 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.151446:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.151493:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcc69 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.151507:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc69 expref: 12 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100277.151520:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011130972 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1877056126192512:0@lo:104: 00000100:00100000:0.0:1790100277.151579:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100277.151651:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fe6f4c5 going to sleep for 11 seconds 00000100:00100000:3.0:1790100277.151820:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126192512 00000100:00100000:3.0:1790100277.151829:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126192512 00000100:00100000:3.0:1790100277.151957:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100277.151966:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062366fa5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5857:x1877056126192512:12345-0@lo:104: 00010000:00010000:3.0:1790100277.151980:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.152042:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100277.152048:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062366fa5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5857:x1877056126192512:12345-0@lo:104: Request processed in 83us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100277.152054:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100277.152120:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011130972 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1877056126192512:0@lo:104: 00010000:00010000:1.0:1790100277.152138:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.152216:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100277.152221:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.152228:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008016c611 already unused, calling callback (000000008fc916f1) 10000000:00010000:3.0:1790100277.152231:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.152238:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100277.152253:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100277.152258:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100277.152941:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.152950:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790100277.153062:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b4bd176 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126192640:0@lo:103: 00000100:00100000:1.0:1790100277.153094:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100277.153133:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126192640 00000100:00100000:0.0:1790100277.153140:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126192640 00010000:00010000:0.0:1790100277.153160:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc69 expref: 13 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100277.153184:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100277.153190:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004dd55143 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:3312:x1877056126192640:12345-0@lo:103: 00010000:00010000:0.0:1790100277.153201:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100277.153204:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc69 expref: 13 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153213:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc69 expref: 13 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153224:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c164e21/0x31a8f3fdeeefcc70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc69 expref: 13 pid: 5835 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153245:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153253:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790100277.153265:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001874759s 00010000:00010000:0.0:1790100277.153270:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153276:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153282:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153288:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153293:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000785e88f0 already unused, calling callback (0000000053f73f3e) 00010000:00010000:0.0:1790100277.153297:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153303:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153345:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100277.153355:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100277.153358:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100277.153365:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100277.153370:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000785e88f0/0x31a8f3fdeeefcca1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.153403:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.153410:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 000000008016c611/0x31a8f3fdeeefcc69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc70 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100277.153434:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100277.153436:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100277.153437:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100277.153560:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004dd55143 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:3312:x1877056126192640:12345-0@lo:103: Request processed in 370us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100277.153561:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b4bd176 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126192640:0@lo:103: 00000100:00100000:0.0:1790100277.153568:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100277.157341:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7a6c100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+11:5823:x1877056126192384:12345-0@lo:253: Request processed in 23284us (23349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100277.157590:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fd7a1fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:5823:1877056126192384:0@lo:253: 10000000:01000000:0.0:1790100277.157605:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790100277.157607:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790100277.157633:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790100277.157635:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100277.157637:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100277.157638:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100277.157639:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100277.157640:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790100277.157642:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790100277.157643:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790100277.157644:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790100277.157646:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100277.157647:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790100277.157661:0:5823:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790100277.157994:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00080000:10000000:0.0:1790100277.161419:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100277.164110:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790100277.164347:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100277.166931:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790100277.167198:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100277.167372:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790100277.172690:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790100277.173110:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790100277.173319:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790100277.173524:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790100277.173765:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790100277.173960:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1790100277.242361:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1790100277.269030:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1790100277.269229:0:5874:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1790100277.269233:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790100277.269336:0:5875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790100277.271958:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1790100277.272112:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1790100277.272539:0:5823:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1790100277.272546:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1790100277.272697:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100277.274569:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790100277.275519:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790100277.275562:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790100277.275841:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790100277.276047:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1790100277.285671:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790100277.285821:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790100277.285980:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790100277.286105:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790100277.288409:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1790100277.288568:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1790100277.289533:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1790100277.290021:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1790100277.290178:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1790100277.290317:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790100277.290727:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790100277.290851:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1790100277.291012:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1790100277.291145:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1790100277.291285:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1790100277.291416:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1790100277.291747:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790100277.291896:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790100277.292330:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790100277.292468:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790100277.292831:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790100277.292981:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790100277.293216:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790100277.293358:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790100277.293507:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790100277.293667:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790100277.293826:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790100277.293977:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790100277.294330:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790100277.294479:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790100277.294663:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790100277.294806:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790100277.295014:0:5823:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1790100277.321529:0:5875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1790100277.362975:0:5823:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790100277.363009:0:5823:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb05f81827988 00100000:10000000:1.0:1790100277.363016:0:5823:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790100277.364672:0:5823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790100277.364688:0:5823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790100277.364713:0:5823:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790100277.364733:0:5823:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1790100277.392390:0:5875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790100277.392467:0:5875:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790100277.392479:0:5875:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1790100277.543774:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100278.565906:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100279.591740:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100280.614692:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790100280.934754:0:6118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790100281.642191:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790100282.597733:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790100282.597743:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790100282.597746:0:37:0:(import.c:65:import_set_state_nolock()) 000000004f6274d7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790100282.597762:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004f6274d7 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:2.0:1790100282.597782:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007cb9179b x1877056126192896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790100282.597827:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007cb9179b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126192896:0@lo:38: 00000100:00100000:2.0:1790100282.597893:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100282.598560:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007651a30a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126192768:0@lo:400: 00000100:00100000:1.0:1790100282.598603:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100282.598699:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126192896 00000100:00100000:1.0:1790100282.598707:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126192896 00000100:00100000:1.0:1790100282.598742:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100282.598747:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a913c09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1877056126192896:12345-0@lo:38: 00010000:00080000:1.0:1790100282.598772:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1790100282.598808:0:5843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x31a8f3fdeeefcca8 00000100:00100000:3.0:1790100282.600036:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126192768 00000100:00100000:3.0:1790100282.600054:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126192768 00000100:00100000:3.0:1790100282.600095:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790100282.600102:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002489cf02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+11:3313:x1877056126192768:12345-0@lo:400: 00000100:00100000:3.0:1790100282.600160:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002489cf02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+11:3313:x1877056126192768:12345-0@lo:400: Request processed in 60us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100282.600167:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790100282.600208:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007651a30a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126192768:0@lo:400: 00000004:00100000:1.0:1790100282.603116:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790100282.603254:0:5843:0:(import.c:65:import_set_state_nolock()) 0000000050a2965f : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100282.603347:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a913c09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877056126192896:12345-0@lo:38: Request processed in 4598us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100282.603365:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790100282.604008:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007cb9179b x1877056126192896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790100282.604033:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790100282.604041:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790100282.604046:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790100282.604048:0:3310:0:(import.c:65:import_set_state_nolock()) 000000004f6274d7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790100282.604054:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007cb9179b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126192896:0@lo:38: 00010000:00010000:2.0:1790100282.662708:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100283.685756:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790100284.134842:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790100284.134849:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6788844800 from 3 10000000:01000000:1.0:1790100284.134854:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790100284.134902:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 0000000068d90553/0x31a8f3fdeeefccaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100284.134926:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 0000000068d90553/0x31a8f3fdeeefccaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100284.134936:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 0000000068d90553/0x31a8f3fdeeefccaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100284.134984:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dce42b30 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126193024:0@lo:101: 00000100:00100000:1.0:1790100284.135065:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100284.135121:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053153db8 going to sleep for 11 seconds 00000100:00100000:3.0:1790100284.138515:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126193024 00000100:00100000:3.0:1790100284.138532:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126193024 00000100:00100000:3.0:1790100284.138649:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790100284.138661:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8a3cb35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+11:5838:x1877056126193024:12345-0@lo:101: 00010000:00010000:3.0:1790100284.138678:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100284.138696:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086461d00/0x31a8f3fdeeefccb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefccaf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100284.138724:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086461d00/0x31a8f3fdeeefccb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefccaf expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100284.138736:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086461d00/0x31a8f3fdeeefccb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefccaf expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100284.138767:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086461d00, rc 0) 00000100:00100000:3.0:1790100284.138855:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8a3cb35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126193024:12345-0@lo:101: Request processed in 198us (3791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100284.138863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100284.139285:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dce42b30 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126193024:0@lo:101: 00010000:00010000:1.0:1790100284.139302:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 0000000068d90553/0x31a8f3fdeeefccaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100284.139311:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 0000000068d90553/0x31a8f3fdeeefccaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100284.139376:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dce42b30 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126193152:0@lo:256: 00000100:00100000:1.0:1790100284.139416:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100284.139458:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053153db8 going to sleep for 11 seconds 00000100:00100000:2.0:1790100284.139527:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126193152 00000100:00100000:2.0:1790100284.139533:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126193152 00000100:00100000:2.0:1790100284.139570:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790100284.139577:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a547a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126193152:12345-0@lo:256: 20000000:01000000:2.0:1790100284.139592:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790100284.139623:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790100284.139626:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790100284.139706:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a547a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126193152:12345-0@lo:256: Request processed in 129us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100284.139713:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790100284.139747:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dce42b30 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126193152:0@lo:256: 10000000:01000000:2.0:1790100284.139798:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790100284.139810:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 0000000068d90553/0x31a8f3fdeeefccaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100284.139818:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 0000000068d90553/0x31a8f3fdeeefccaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100284.709978:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790100285.395345:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcaf9ee590 20000000:00000080:0.0:1790100285.395362:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d6784fe1400 uarg=0000000000000000 20000000:01000000:0.0:1790100285.395394:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790100285.395401:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790100285.395405:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790100285.396221:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1790100285.396233:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1790100285.400431:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100285.401328:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790100285.401392:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1790100285.401458:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1790100285.401475:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790100285.401493:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.401511:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc77 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.401519:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.401558:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcc77 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.401587:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc77 expref: 11 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100285.401601:0:6320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eea4d81a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1877056126193280:0@lo:104: 00000100:00100000:0.0:1790100285.401690:0:6320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100285.401731:0:6320:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487ad543 going to sleep for 11 seconds 00000100:00100000:3.0:1790100285.401901:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126193280 00000100:00100000:3.0:1790100285.401908:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126193280 00000100:00100000:3.0:1790100285.401955:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100285.401962:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f6f65d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:6320:x1877056126193280:12345-0@lo:104: 00010000:00010000:3.0:1790100285.401972:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100285.402139:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100285.402145:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f6f65d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:6320:x1877056126193280:12345-0@lo:104: Request processed in 183us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100285.402151:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100285.402213:0:6320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eea4d81a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1877056126193280:0@lo:104: 00010000:00010000:0.0:1790100285.402230:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402281:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100285.402287:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402294:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c1a2c88c already unused, calling callback (000000008fc916f1) 10000000:00010000:1.0:1790100285.402297:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402305:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100285.402312:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100285.402328:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790100285.402365:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402372:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100285.402397:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402403:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 00000000c1a2c88c/0x31a8f3fdeeefcc77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc7e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402421:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100285.402422:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100285.402424:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100285.402431:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100285.402441:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f957d0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126193408:0@lo:103: 00000100:00100000:1.0:1790100285.402472:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100285.402515:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126193408 00000100:00100000:1.0:1790100285.402519:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126193408 00010000:00010000:1.0:1790100285.402536:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc77 expref: 12 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100285.402559:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100285.402565:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000111ea41c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:3313:x1877056126193408:12345-0@lo:103: 00010000:00010000:1.0:1790100285.402573:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100285.402577:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc77 expref: 12 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402586:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc77 expref: 12 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402604:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061d4f833/0x31a8f3fdeeefcc7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc77 expref: 12 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402709:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402716:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402728:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402734:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402740:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402745:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402750:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efade3f9 already unused, calling callback (0000000053f73f3e) 00010000:00010000:1.0:1790100285.402753:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402759:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402779:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100285.402797:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100285.402827:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000111ea41c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+11:3313:x1877056126193408:12345-0@lo:103: Request processed in 263us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100285.402834:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100285.402863:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f957d0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126193408:0@lo:103: 00010000:00010000:0.0:1790100285.402942:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.402950:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100285.402955:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccbd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100285.734290:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100286.757800:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100287.717853:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001199f5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126193664:0@lo:400: 00000100:00100000:0.0:1790100287.717941:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100287.718109:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100287.718115:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eea4d81a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126193536:0@lo:400: 00000100:00100000:0.0:1790100287.718146:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100287.718176:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126193664 00000100:00100000:0.0:1790100287.718184:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126193664 00000100:00100000:0.0:1790100287.718225:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100287.718232:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9374244 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126193664:12345-0@lo:400: 00000100:00100000:0.0:1790100287.718299:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9374244 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126193664:12345-0@lo:400: Request processed in 67us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100287.718307:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100287.718331:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126193536 00000100:00100000:0.0:1790100287.718334:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126193536 00000100:00100000:0.0:1790100287.718357:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100287.718362:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a067e31a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+11:3312:x1877056126193536:12345-0@lo:400: 00000100:00100000:0.0:1790100287.718388:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a067e31a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+11:3312:x1877056126193536:12345-0@lo:400: Request processed in 26us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100287.718394:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100287.718432:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eea4d81a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126193536:0@lo:400: 00010000:00080000:0.0:1790100287.718443:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001199f5b9 x1877056126193664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100287.718453:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001199f5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126193664:0@lo:400: 00010000:00010000:2.0:1790100287.781847:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100288.806105:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100289.837898:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790100290.230905:0:6685:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790100290.230909:0:6685:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1790100290.231043:0:6685:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000013d5170b 00000020:01000004:3.0:1790100290.231061:0:6685:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790100290.231073:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790100290.231092:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000069625aca) 00000020:00000080:3.0:1790100290.231111:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790100290.245501:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1790100290.245798:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1790100290.263594:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1790100290.268981:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790100290.269026:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1790100290.269090:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790100290.269127:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1790100290.269443:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790100290.269454:0:6685:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790100290.269464:0:6685:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x31a8f3fdeeefcccb 00000020:01000004:0.0:1790100290.269471:0:6685:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1790100290.269490:0:6685:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790100290.269493:0:6685:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790100290.269505:0:6685:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790100290.269510:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790100290.269520:0:6685:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000036574c1f) 00000020:00000080:0.0:1790100290.269531:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1790100290.271356:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100290.271530:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790100290.271536:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790100290.276604:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790100290.276638:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790100290.277344:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790100290.277351:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790100290.278545:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100290.278757:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790100290.278763:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1790100290.281232:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1790100290.281245:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790100290.318230:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100290.318397:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790100290.318406:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790100290.322255:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790100290.322272:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790100290.325080:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790100290.325094:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790100290.329203:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100290.329417:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790100290.329423:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790100290.330146:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790100290.330153:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790100290.375247:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100290.375453:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790100290.375460:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790100290.377145:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790100290.377154:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790100290.377902:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790100290.377992:0:6685:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790100290.377999:0:6685:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790100290.401275:0:6685:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790100290.401312:0:6685:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790100290.401316:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790100290.401318:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100290.401319:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100290.401320:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100290.401321:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100290.401323:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100290.401324:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100290.401326:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100290.401327:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100290.401328:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100290.401330:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100290.401332:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790100290.401335:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100290.401336:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100290.401337:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100290.401338:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100290.401340:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100290.401340:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100290.401341:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100290.401342:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100290.401343:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100290.401348:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100290.401349:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100290.401380:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790100290.401396:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d681d5b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126193792:0@lo:253: 00000100:00100000:2.0:1790100290.401459:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100290.401581:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db4dcd3e going to sleep for 11 seconds 00000100:00100000:1.0:1790100290.401854:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126193792 00000100:00100000:1.0:1790100290.401862:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126193792 00000100:00100000:1.0:1790100290.402002:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790100290.402011:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c09a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+11:6685:x1877056126193792:12345-0@lo:253: 20000000:01000000:1.0:1790100290.402041:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790100290.402045:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1790100290.402049:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1790100290.402053:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1790100290.403352:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100290.403569:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1790100290.403583:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1790100290.403824:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1790100290.403833:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1790100290.403868:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1790100290.403997:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1790100290.404360:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1790100290.404380:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:1.0:1790100290.404383:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:1.0:1790100290.404425:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1790100290.404433:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790100290.404485:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1790100290.404493:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:1.0:1790100290.404522:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1790100290.404531:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1790100290.404559:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1790100290.404604:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1790100290.405570:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1790100290.405587:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:1.0:1790100290.405589:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:1.0:1790100290.405902:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1790100290.405911:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790100290.406018:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1790100290.406025:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:1.0:1790100290.406069:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1790100290.406078:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1790100290.406109:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1790100290.406160:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1790100290.406180:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1790100290.406184:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1790100290.406189:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790100290.406190:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790100290.406192:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790100290.406206:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790100290.406208:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790100290.406239:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790100290.406242:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790100290.407325:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1790100290.407387:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1790100290.407444:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1790100290.408065:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1790100290.408105:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1790100290.408161:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1790100290.408174:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790100290.408184:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790100290.408584:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1790100290.408809:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1790100290.408862:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1790100290.409175:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1790100290.409212:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1790100290.409242:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1790100290.409252:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790100290.409254:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790100290.409566:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1790100290.410097:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1790100290.410162:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1790100290.410221:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1790100290.410240:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790100290.410258:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.410275:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcbf9 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.410282:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc15 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.410288:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc85 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.410294:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.410331:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcc85 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.410346:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc85 expref: 11 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100290.410359:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001199f5b9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126193920:0@lo:104: 00000100:00100000:0.0:1790100290.410425:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100290.410523:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcc15 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.410532:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc15 expref: 11 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100290.410540:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e75afd7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126194048:0@lo:104: 00000100:00100000:0.0:1790100290.410561:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100290.410846:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcbf9 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.410854:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcbf9 expref: 11 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100290.410862:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085283a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126194176:0@lo:104: 00000100:00100000:0.0:1790100290.410883:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100290.410987:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126193920 00000100:00100000:2.0:1790100290.410997:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126193920 00000100:00100000:2.0:1790100290.411032:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126194048 00000100:00100000:2.0:1790100290.411035:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126194048 00000100:00100000:2.0:1790100290.411050:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100290.411057:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eea4d81a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+4:5836:x1877056126193920:12345-0@lo:104: 00010000:00010000:2.0:1790100290.411068:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.411157:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100290.411164:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eea4d81a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+4:5836:x1877056126193920:12345-0@lo:104: Request processed in 108us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100290.411170:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100290.411188:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100290.411193:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000610304a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5836:x1877056126194048:12345-0@lo:104: 00010000:00010000:2.0:1790100290.411200:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100290.411252:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 0000000095bad400 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.411271:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001199f5b9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126193920:0@lo:104: 00000100:00100000:0.0:1790100290.411277:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e75afd7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126194048:0@lo:104: 00000100:00100000:3.0:1790100290.411310:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126194176 00000100:00100000:3.0:1790100290.411314:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126194176 00010000:00010000:1.0:1790100290.411353:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100290.411358:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411366:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efde2c9b already unused, calling callback (000000008fc916f1) 10000000:00010000:1.0:1790100290.411369:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411375:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100290.411381:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100290.411387:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100290.411418:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411424:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100290.411448:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411455:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 00000000efde2c9b/0x31a8f3fdeeefcc85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc8c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411467:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100290.411480:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411485:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c359b06e already unused, calling callback (000000008fc916f1) 10000000:00010000:1.0:1790100290.411488:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411492:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100290.411497:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100290.411502:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100290.411514:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411519:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100290.411523:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411528:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcc15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.411538:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100290.411539:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100290.411541:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100290.411552:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000780558f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126194432:0@lo:103: 00000100:00100000:1.0:1790100290.411580:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100290.411599:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100290.411604:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f957d0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126194304:0@lo:103: 00000100:00100000:1.0:1790100290.411664:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100290.411700:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126194432 00000100:00100000:1.0:1790100290.411705:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126194432 00010000:00010000:1.0:1790100290.411873:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc15 expref: 12 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100290.411986:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126194304 00000100:00100000:1.0:1790100290.411990:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126194304 00010000:00010000:1.0:1790100290.412004:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc85 expref: 13 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.412060:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1790100290.412066:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000610304a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+4:5836:x1877056126194048:12345-0@lo:104: Request processed in 873us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100290.412072:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100290.412090:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100290.412096:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e11dd7a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5836:x1877056126194176:12345-0@lo:104: 00010000:00010000:2.0:1790100290.412109:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.412152:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100290.412156:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e11dd7a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5836:x1877056126194176:12345-0@lo:104: Request processed in 62us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100290.412162:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790100290.412177:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100290.412180:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.412186:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046d51817 already unused, calling callback (000000008fc916f1) 10000000:00010000:2.0:1790100290.412188:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.412194:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100290.412199:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100290.412203:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100290.412222:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.412227:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100290.412240:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.412244:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 0000000046d51817/0x31a8f3fdeeefcbf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcc00 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.412264:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100290.412265:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100290.412267:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100290.412276:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ed9bb7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126194560:0@lo:103: 00000100:00100000:2.0:1790100290.412300:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100290.412329:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100290.412438:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126194560 00000100:00100000:0.0:1790100290.412443:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126194560 00010000:00010000:0.0:1790100290.412458:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcbf9 expref: 14 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100290.412473:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100290.412478:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000491ef7da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:3314:x1877056126194432:12345-0@lo:103: 00010000:00010000:0.0:1790100290.412486:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100290.412491:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc15 expref: 14 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412505:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc15 expref: 14 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412517:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c087a81e/0x31a8f3fdeeefcc1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc15 expref: 14 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412528:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100290.412595:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000491ef7da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:3314:x1877056126194432:12345-0@lo:103: Request processed in 118us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.412602:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100290.412645:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100290.412651:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec630599 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:3314:x1877056126194304:12345-0@lo:103: 00010000:00010000:0.0:1790100290.412658:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100290.412662:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc85 expref: 12 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412670:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc85 expref: 12 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412690:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078424fdb/0x31a8f3fdeeefcc8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcc85 expref: 12 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412699:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100290.412839:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec630599 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+11:3314:x1877056126194304:12345-0@lo:103: Request processed in 189us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.412846:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100290.412860:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100290.412866:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004d30e2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+10:3311:x1877056126194560:12345-0@lo:103: 00010000:00010000:0.0:1790100290.412880:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100290.412883:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcbf9 expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412891:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcbf9 expref: 10 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412901:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412909:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.412995:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413001:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413007:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413013:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413017:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efade3f9 already unused, calling callback (0000000053f73f3e) 00010000:00010000:0.0:1790100290.413020:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413027:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413045:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413055:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100290.413092:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004d30e2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+10:3311:x1877056126194560:12345-0@lo:103: Request processed in 227us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.413099:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790100290.413130:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcc00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcbf9 expref: 9 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100290.413140:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085283a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126194176:0@lo:104: 00010000:00010000:0.0:1790100290.413158:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413166:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413170:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.413175:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccd9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790100290.413187:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790100290.413264:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ed9bb7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126194560:0@lo:103: 00000100:00100000:2.0:1790100290.413398:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000780558f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126194432:0@lo:103: 00000100:00100000:2.0:1790100290.413411:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f957d0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126194304:0@lo:103: 00000100:00100000:2.0:1790100290.455316:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c09a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+8:6685:x1877056126193792:12345-0@lo:253: Request processed in 53299us (53850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100290.455333:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790100290.455431:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d681d5b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126193792:0@lo:253: 10000000:01000000:3.0:1790100290.455447:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790100290.455463:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100290.455465:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790100290.455466:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100290.455467:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1790100290.455469:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100290.455470:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100290.455471:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100290.455473:0:6685:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790100290.455474:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100290.455475:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790100290.455493:0:6685:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000013d5170b from lustre-OST0000 10000000:01000000:3.0:1790100290.455517:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1790100290.455521:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790100290.455528:0:6685:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d6784edb380 local copy 10000000:01000000:3.0:1790100290.455531:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790100290.455566:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.455576:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.455585:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100290.455603:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126194688:0@lo:101: 00000100:00100000:3.0:1790100290.455670:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100290.455813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126194688 00000100:00100000:2.0:1790100290.455820:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126194688 00000100:00100000:3.0:1790100290.455860:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8bc16c3 going to sleep for 11 seconds 00000100:00100000:2.0:1790100290.456059:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100290.456069:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f97d6684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+8:6685:x1877056126194688:12345-0@lo:101: 00010000:00010000:2.0:1790100290.456080:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100290.456092:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046d51817/0x31a8f3fdeeefcce7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcce0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.456113:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046d51817/0x31a8f3fdeeefcce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcce0 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.456123:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046d51817/0x31a8f3fdeeefcce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcce0 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.456131:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046d51817, rc 0) 00000100:00100000:2.0:1790100290.456209:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f97d6684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+9:6685:x1877056126194688:12345-0@lo:101: Request processed in 143us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100290.456222:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790100290.456325:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126194688:0@lo:101: 00010000:00010000:3.0:1790100290.456337:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.456345:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100290.456462:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126194816:0@lo:501: 00000100:00100000:3.0:1790100290.456490:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.456550:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8bc16c3 going to sleep for 11 seconds 00000100:00100000:2.0:1790100290.456587:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126194816 00000100:00100000:2.0:1790100290.456591:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126194816 00000100:00100000:2.0:1790100290.456687:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790100290.456694:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083d7d84f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+9:6685:x1877056126194816:12345-0@lo:501: 00000100:00100000:2.0:1790100290.457020:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083d7d84f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+9:6685:x1877056126194816:12345-0@lo:501: Request processed in 326us (529us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790100290.457027:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790100290.457087:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126194816:0@lo:501: 10000000:01000000:3.0:1790100290.457099:0:6685:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790100290.457124:0:6685:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790100290.457129:0:6685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.457136:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.457142:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.457155:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790100290.457186:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d67ad888800 10000000:01000000:3.0:1790100290.457191:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790100290.457196:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d6784edb380 10000000:01000000:3.0:1790100290.457198:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790100290.457201:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d6784edb380 from 1 10000000:01000000:3.0:1790100290.457203:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790100290.457219:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 0000000037a109d4/0x31a8f3fdeeefccee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.457225:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 0000000037a109d4/0x31a8f3fdeeefccee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.457244:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 0000000037a109d4/0x31a8f3fdeeefccee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100290.457255:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126194944:0@lo:101: 00000100:00100000:3.0:1790100290.457281:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790100290.457321:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100290.457327:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.457334:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081742eb2 already unused, calling callback (000000008fc916f1) 10000000:00010000:1.0:1790100290.457337:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.457344:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100290.457350:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100290.457355:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100290.457373:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.457379:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100290.457406:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.457421:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: 0000000081742eb2/0x31a8f3fdeeefcce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x31a8f3fdeeefcce7 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.457435:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100290.457437:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100290.457438:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100290.457447:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100290.457458:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f03b973d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126195072:0@lo:103: 00000100:00100000:1.0:1790100290.457485:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100290.457522:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126195072 00000100:00100000:1.0:1790100290.457526:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126195072 00000100:00100000:1.0:1790100290.457557:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100290.457564:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000027225ab3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+9:3311:x1877056126195072:12345-0@lo:103: 00010000:00010000:1.0:1790100290.457573:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100290.457584:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046d51817/0x31a8f3fdeeefcce7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcce0 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.457597:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100290.457652:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000027225ab3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+8:3311:x1877056126195072:12345-0@lo:103: Request processed in 90us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100290.457659:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100290.457699:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f03b973d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126195072:0@lo:103: 00000100:00100000:3.0:1790100290.458235:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086ee2d62 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.458294:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126194944 00000100:00100000:0.0:1790100290.458301:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126194944 00000100:00100000:0.0:1790100290.458325:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790100290.458331:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008edec1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+8:6685:x1877056126194944:12345-0@lo:101: 00010000:00010000:0.0:1790100290.458342:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100290.458360:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccf5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefccee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.458379:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccf5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefccee expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.458388:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efade3f9/0x31a8f3fdeeefccf5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefccee expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.458394:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efade3f9, rc 0) 00000100:00100000:0.0:1790100290.458440:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008edec1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+9:6685:x1877056126194944:12345-0@lo:101: Request processed in 109us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.458446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790100290.458524:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126194944:0@lo:101: 00010000:00010000:3.0:1790100290.458537:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 0000000037a109d4/0x31a8f3fdeeefccee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefccf5 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.458544:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 0000000037a109d4/0x31a8f3fdeeefccee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefccf5 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100290.458559:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790100290.458574:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 0000000037a109d4/0x31a8f3fdeeefccee lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefccf5 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.458581:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 0000000037a109d4/0x31a8f3fdeeefccee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefccf5 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100290.458587:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790100290.458592:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790100290.458596:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790100290.458599:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790100290.458629:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e803d7e8/0x31a8f3fdeeefccfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.458635:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000e803d7e8/0x31a8f3fdeeefccfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.458648:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000e803d7e8/0x31a8f3fdeeefccfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100290.458660:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195200:0@lo:101: 00000100:00100000:3.0:1790100290.458700:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.458711:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086ee2d62 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.458828:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126195200 00000100:00100000:0.0:1790100290.458833:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126195200 00000100:00100000:0.0:1790100290.458850:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790100290.458855:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d327baae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+9:6685:x1877056126195200:12345-0@lo:101: 00010000:00010000:0.0:1790100290.458863:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100290.458870:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcd03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefccfc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.458882:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefccfc expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.458888:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d60d71c9/0x31a8f3fdeeefcd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefccfc expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.458895:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d60d71c9, rc 0) 00000100:00100000:0.0:1790100290.459011:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d327baae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195200:12345-0@lo:101: Request processed in 155us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.459026:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790100290.459133:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195200:0@lo:101: 00010000:00010000:3.0:1790100290.459143:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000e803d7e8/0x31a8f3fdeeefccfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.459150:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000e803d7e8/0x31a8f3fdeeefccfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100290.459223:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195328:0@lo:501: 00000100:00100000:3.0:1790100290.459247:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.459273:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086ee2d62 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.459320:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126195328 00000100:00100000:0.0:1790100290.459324:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126195328 00000100:00100000:0.0:1790100290.459340:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790100290.459345:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ba2bb4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195328:12345-0@lo:501: 00000100:00100000:0.0:1790100290.459554:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ba2bb4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195328:12345-0@lo:501: Request processed in 208us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.459562:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790100290.459637:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195328:0@lo:501: 00000100:00100000:3.0:1790100290.459662:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195456:0@lo:503: 00000100:00100000:3.0:1790100290.459711:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.459807:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086ee2d62 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.459856:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126195456 00000100:00100000:0.0:1790100290.459860:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126195456 00000100:00100000:0.0:1790100290.459876:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790100290.459880:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b9abb59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195456:12345-0@lo:503: 00000100:00100000:0.0:1790100290.460124:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b9abb59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195456:12345-0@lo:503: Request processed in 243us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.460131:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100290.460343:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195456:0@lo:503: 00000040:00080000:3.0:1790100290.460645:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100290.460890:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195584:0@lo:502: 00000100:00100000:3.0:1790100290.461012:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.461091:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086ee2d62 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.461163:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126195584 00000100:00100000:0.0:1790100290.461169:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126195584 00000100:00100000:2.0:1790100290.461216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100290.461225:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e565fec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195584:12345-0@lo:502: 00000100:00100000:2.0:1790100290.461392:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e565fec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195584:12345-0@lo:502: Request processed in 169us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100290.461399:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790100290.461488:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195584:0@lo:502: 00000040:00080000:3.0:1790100290.462021:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790100290.462076:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790100290.462107:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790100290.462166:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790100290.462203:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790100290.462235:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790100290.462263:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195712:0@lo:502: 00000100:00100000:3.0:1790100290.462308:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.462382:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086ee2d62 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.462459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126195712 00000100:00100000:0.0:1790100290.462465:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126195712 00000100:00100000:0.0:1790100290.462490:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790100290.462497:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000324b097c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195712:12345-0@lo:502: 00000100:00100000:0.0:1790100290.462689:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000324b097c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195712:12345-0@lo:502: Request processed in 183us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.462696:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790100290.462876:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9b4f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195712:0@lo:502: 00000040:00080000:1.0:1790100290.462971:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790100290.462981:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1790100290.463501:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790100290.463514:0:6703:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790100290.463520:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100290.463522:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790100290.463527:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100290.463540:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000eb35dcb4) 00000020:00000080:1.0:1790100290.463560:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790100290.463565:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790100290.463648:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000013d5170b from lustre-OST0000, refs=2 00080000:01000000:1.0:1790100290.463655:0:6703:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790100290.463670:0:6703:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x31a8f3fdeeefcd11 00010000:00010000:3.0:1790100290.470343:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1790100290.470906:0:6703:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1790100290.473394:0:6703:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790100290.474176:0:6703:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1790100290.480095:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790100290.480547:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1790100290.482298:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790100290.482309:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100290.482314:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100290.482316:0:6703:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790100290.482319:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100290.482323:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100290.482324:0:6703:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790100290.482327:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790100290.482330:0:6703:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790100290.482379:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100290.482382:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100290.482383:0:6703:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790100290.482386:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790100290.482527:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1790100290.482551:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790100290.482572:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: 00000000e803d7e8/0x31a8f3fdeeefccfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.482584:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: 00000000e803d7e8/0x31a8f3fdeeefccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100290.482592:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67ad888800 from 1 10000000:01000000:1.0:1790100290.482594:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100290.482845:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcd18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.482854:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcd18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.482864:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcd18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100290.482886:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f03b973d pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195840:0@lo:101: 00000100:00100000:1.0:1790100290.483047:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100290.483129:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0f01856 going to sleep for 11 seconds 00000100:00100000:3.0:1790100290.486095:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126195840 00000100:00100000:3.0:1790100290.486111:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126195840 00000100:00100000:3.0:1790100290.486231:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790100290.486241:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe7f04c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+10:6685:x1877056126195840:12345-0@lo:101: 00010000:00010000:3.0:1790100290.486259:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100290.486278:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ede14ac/0x31a8f3fdeeefcd1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcd18 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.486303:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ede14ac/0x31a8f3fdeeefcd1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd18 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.486314:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ede14ac/0x31a8f3fdeeefcd1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd18 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.486322:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ede14ac, rc 0) 00000100:00100000:3.0:1790100290.486399:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe7f04c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+11:6685:x1877056126195840:12345-0@lo:101: Request processed in 160us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100290.486406:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790100290.487437:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f03b973d pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195840:0@lo:101: 00010000:00010000:2.0:1790100290.487455:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcd18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.487464:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: 00000000c359b06e/0x31a8f3fdeeefcd18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100290.487569:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adebea78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195968:0@lo:501: 00000100:00100000:2.0:1790100290.487654:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100290.488140:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efb391d4 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.491863:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126195968 00000100:00100000:0.0:1790100290.491879:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126195968 00000100:00100000:0.0:1790100290.492130:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790100290.492149:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022d7257e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+11:6685:x1877056126195968:12345-0@lo:501: 00000100:00100000:0.0:1790100290.492433:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022d7257e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+11:6685:x1877056126195968:12345-0@lo:501: Request processed in 286us (4779us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.492541:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790100290.492703:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adebea78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126195968:0@lo:501: 00000100:00100000:3.0:1790100290.492753:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c983f9af pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196096:0@lo:503: 00000100:00100000:3.0:1790100290.492797:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.492827:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1459ca3 going to sleep for 11 seconds 00000100:00100000:1.0:1790100290.492883:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126196096 00000100:00100000:1.0:1790100290.492889:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126196096 00000100:00100000:1.0:1790100290.492924:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790100290.492930:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007bdc6157 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196096:12345-0@lo:503: 00000100:00100000:1.0:1790100290.493251:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007bdc6157 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196096:12345-0@lo:503: Request processed in 321us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100290.493259:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790100290.493330:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c983f9af pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196096:0@lo:503: 00000040:00080000:3.0:1790100290.493596:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100290.493699:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c983f9af pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196224:0@lo:502: 00000100:00100000:3.0:1790100290.493734:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.493759:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1459ca3 going to sleep for 11 seconds 00000100:00100000:3.0:1790100290.493775:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126196224 00000100:00100000:3.0:1790100290.493780:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126196224 00000100:00100000:3.0:1790100290.493807:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790100290.493812:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001645c654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196224:12345-0@lo:502: 00000100:00100000:3.0:1790100290.493950:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001645c654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196224:12345-0@lo:502: Request processed in 138us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100290.493962:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790100290.493998:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c983f9af pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196224:0@lo:502: 00000040:00080000:3.0:1790100290.494239:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790100290.494283:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790100290.494302:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c983f9af pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196352:0@lo:502: 00000100:00100000:3.0:1790100290.494334:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.494348:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1459ca3 going to sleep for 11 seconds 00000100:00100000:3.0:1790100290.494361:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126196352 00000100:00100000:3.0:1790100290.494365:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126196352 00000100:00100000:3.0:1790100290.494381:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790100290.494386:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bdeff632 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196352:12345-0@lo:502: 00000100:00100000:3.0:1790100290.494493:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bdeff632 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196352:12345-0@lo:502: Request processed in 107us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100290.494500:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790100290.494534:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c983f9af pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196352:0@lo:502: 00000040:00080000:3.0:1790100290.494599:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790100290.494608:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790100290.496231:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100290.496241:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100290.496243:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790100290.496249:0:6707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67ad888800 00000020:00000080:3.0:1790100290.496251:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100290.496284:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100290.496296:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100290.496298:0:6707:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790100290.496301:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790100290.496423:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790100290.496445:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790100290.496467:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.496485:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100290.496523:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790100290.496525:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d67ad888800 10000000:01000000:2.0:1790100290.496529:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d67ad888800 10000000:01000000:2.0:1790100290.496533:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790100290.496538:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67ad888800 from 1 10000000:01000000:2.0:1790100290.496541:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790100290.496574:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.496582:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.496593:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100290.496636:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196480:0@lo:101: 00000100:00100000:2.0:1790100290.496706:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100290.496745:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad458000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100290.496780:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126196480 00000100:00100000:1.0:1790100290.496787:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126196480 00000100:00100000:1.0:1790100290.496827:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790100290.496835:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196480:12345-0@lo:101: 00010000:00010000:1.0:1790100290.496847:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100290.496858:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcd26 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.496881:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd26 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.496891:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd26 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.496899:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21ff400, rc 0) 00000100:00100000:1.0:1790100290.496947:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:6685:x1877056126196480:12345-0@lo:101: Request processed in 113us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100290.496954:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790100290.497022:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196480:0@lo:101: 00010000:00010000:2.0:1790100290.497034:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100290.497043:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100290.497131:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196608:0@lo:501: 00000100:00100000:2.0:1790100290.497153:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100290.497174:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad458000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100290.497204:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126196608 00000100:00100000:1.0:1790100290.497207:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126196608 00000100:00100000:1.0:1790100290.497227:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790100290.497239:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196608:12345-0@lo:501: 00000100:00100000:1.0:1790100290.497411:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196608:12345-0@lo:501: Request processed in 168us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100290.497419:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790100290.497435:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196608:0@lo:501: 00000100:00100000:2.0:1790100290.497459:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196736:0@lo:503: 00000100:00100000:2.0:1790100290.497496:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100290.497516:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad458000 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.497554:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126196736 00000100:00100000:0.0:1790100290.497559:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126196736 00000100:00100000:0.0:1790100290.497590:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790100290.497598:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196736:12345-0@lo:503: 00000100:00100000:0.0:1790100290.498318:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196736:12345-0@lo:503: Request processed in 718us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.498327:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790100290.502748:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196736:0@lo:503: 00000040:00080000:1.0:1790100290.503128:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790100290.503201:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196864:0@lo:502: 00000100:00100000:1.0:1790100290.503272:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100290.503320:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fd76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100290.503877:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126196864 00000100:00100000:0.0:1790100290.503885:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126196864 00000100:00100000:0.0:1790100290.503926:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790100290.503935:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196864:12345-0@lo:502: 00000100:00100000:0.0:1790100290.504151:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196864:12345-0@lo:502: Request processed in 216us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.504159:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790100290.504357:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196864:0@lo:502: 00000040:00080000:1.0:1790100290.504687:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790100290.504745:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790100290.504781:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790100290.506165:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790100290.506224:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790100290.506271:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790100290.506308:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790100290.506342:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790100290.506386:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790100290.506420:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790100290.506454:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790100290.506497:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790100290.506530:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790100290.506694:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790100290.506748:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790100290.507059:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790100290.507120:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790100290.507174:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790100290.507210:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790100290.507243:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790100290.507327:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790100290.507370:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790100290.507406:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790100290.507469:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790100290.507508:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790100290.508148:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790100290.508247:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790100290.508288:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1790100290.508339:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad884000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196992:0@lo:502: 00000100:00100000:0.0:1790100290.508428:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100290.508518:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818540 going to sleep for 11 seconds 00000100:00100000:2.0:1790100290.508578:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126196992 00000100:00100000:2.0:1790100290.508586:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126196992 00000100:00100000:3.0:1790100290.513546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790100290.513570:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196992:12345-0@lo:502: 00000100:00100000:3.0:1790100290.514526:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126196992:12345-0@lo:502: Request processed in 964us (6094us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100290.514536:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790100290.514881:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad884000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126196992:0@lo:502: 00000040:00080000:0.0:1790100290.515116:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790100290.515143:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1790100290.515733:0:6708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790100290.515748:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d67ad41b380) 00000020:00000080:3.0:1790100290.515769:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1790100290.516124:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d67ad888800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790100290.516130:0:6708:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d67ad888800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790100290.516132:0:6708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67ad888800 3 00010000:00080000:3.0:1790100290.516159:0:6708:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6799ea3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.118@tcp at head 00010000:00010000:3.0:1790100290.518143:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1790100290.518334:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790100290.518366:0:6708:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790100290.518377:0:6708:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x31a8f3fdeeefcd3b 00000100:00080000:3.0:1790100290.518387:0:6708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790100290.518396:0:6708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d6799ea3800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1790100290.518429:0:6708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d678b151f80 x1877056126197120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100290.518496:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1877056126197120:0@lo:38: 00000100:00100000:0.0:1790100290.518566:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790100290.518929:0:6708:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790100290.519013:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126197120 00000100:00100000:1.0:1790100290.519021:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126197120 00000100:00100000:1.0:1790100290.519064:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100290.519070:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1877056126197120:12345-0@lo:38: 00010000:00080000:1.0:1790100290.519092:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1790100290.519119:0:5843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x31a8f3fdeeefcd42 00000004:00100000:1.0:1790100290.519132:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790100290.519164:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d67bf597800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100290.523307:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126197248:0@lo:400: 00000100:00100000:3.0:1790100290.523383:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.523449:0:5841:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790100290.523458:0:5841:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790100290.527328:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877056126197120:12345-0@lo:38: Request processed in 8245us (8750us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100290.527343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100290.527380:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126197248 00000100:00100000:1.0:1790100290.527388:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126197248 00000100:00100000:1.0:1790100290.527458:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100290.527466:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126197248:12345-0@lo:400: 00000100:00100000:1.0:1790100290.527535:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126197248:12345-0@lo:400: Request processed in 70us (4152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100290.527541:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790100290.527590:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d678b153480 x1877056126197248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100290.527605:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126197248:0@lo:400: 00000040:00080000:3.0:1790100290.535149:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:0.0:1790100290.535838:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d678b151f80 x1877056126197120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100290.535851:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100290.535861:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1790100290.535868:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790100290.535872:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790100290.535895:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d6799ea3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790100290.535902:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1877056126197120:0@lo:38: 00000020:01000000:0.0:1790100290.535988:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790100290.536015:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100290.536037:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100290.536049:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790100290.536097:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790100290.536100:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790100290.536101:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100290.536102:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100290.536104:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100290.536105:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100290.536106:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790100290.536108:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790100290.536109:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790100290.536111:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100290.536113:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790100290.536118:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1790100290.536120:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790100290.536122:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790100290.536124:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100290.536125:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100290.536127:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100290.536128:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100290.536129:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790100290.536130:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790100290.536131:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790100290.536132:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100290.536133:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790100290.536155:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790100290.536171:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad884e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126197376:0@lo:253: 00000100:00100000:0.0:1790100290.536246:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100290.536430:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818540 going to sleep for 11 seconds 00000100:00100000:1.0:1790100290.541888:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126197376 00000100:00100000:1.0:1790100290.541905:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126197376 00000100:00100000:0.0:1790100290.542030:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790100290.542041:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6685:x1877056126197376:12345-0@lo:253: 20000000:01000000:0.0:1790100290.542089:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790100290.542104:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790100290.580135:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790100290.580186:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790100290.580895:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790100290.580901:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790100290.581304:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.581324:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781523000/0x31a8f3fdeeefccb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefccaf expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.581333:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.581372:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781523000/0x31a8f3fdeeefccb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefccaf expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.581387:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6781523000/0x31a8f3fdeeefccb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefccaf expref: 12 pid: 5836 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100290.581401:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1877056126197504:0@lo:104: 00000100:00100000:1.0:1790100290.581461:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100290.581533:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787750540 going to sleep for 11 seconds 00000100:00100000:3.0:1790100290.581594:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126197504 00000100:00100000:3.0:1790100290.581602:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126197504 00000100:00100000:3.0:1790100290.581665:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100290.581673:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5857:x1877056126197504:12345-0@lo:104: 00010000:00010000:3.0:1790100290.581696:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefccaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.581753:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100290.581760:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5857:x1877056126197504:12345-0@lo:104: Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100290.581766:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1790100290.581787:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100290.581793:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefccaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.581811:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21ff800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1790100290.581815:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefccaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.581822:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefccaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100290.581829:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefccaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100290.581835:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100290.581862:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefccaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.581868:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100290.581892:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefccaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.581899:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefccaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefccb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.581922:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100290.581924:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100290.581925:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100290.581943:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126197632:0@lo:103: 00000100:00100000:3.0:1790100290.581974:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100290.582013:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126197632 00000100:00100000:3.0:1790100290.582016:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126197632 00010000:00010000:3.0:1790100290.582032:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781523000/0x31a8f3fdeeefccb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefccaf expref: 13 pid: 5836 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100290.582053:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100290.582059:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:3314:x1877056126197632:12345-0@lo:103: 00010000:00010000:3.0:1790100290.582068:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100290.582072:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781523000/0x31a8f3fdeeefccb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefccaf expref: 13 pid: 5836 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582082:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781523000/0x31a8f3fdeeefccb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefccaf expref: 13 pid: 5836 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582096:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582104:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790100290.582126:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001874759s 00010000:00010000:3.0:1790100290.582130:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582137:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582144:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582151:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582156:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21ff000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100290.582160:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582168:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582177:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100290.582185:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100290.582213:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784ef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:3314:x1877056126197632:12345-0@lo:103: Request processed in 155us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100290.582220:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100290.582276:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126197632:0@lo:103: 00010000:00010000:1.0:1790100290.582531:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781523000/0x31a8f3fdeeefccb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefccaf expref: 12 pid: 5836 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100290.582541:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1877056126197504:0@lo:104: 00010000:00010000:1.0:1790100290.582552:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.582561:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.582568:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100290.582576:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefcd49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100290.592604:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+11:6685:x1877056126197376:12345-0@lo:253: Request processed in 50552us (56345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100290.592650:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790100290.592768:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad884e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:6685:1877056126197376:0@lo:253: 10000000:01000000:1.0:1790100290.592783:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790100290.592786:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790100290.592788:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790100290.592789:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100290.592790:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100290.592792:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100290.592793:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100290.592795:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100290.592796:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790100290.592798:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790100290.592800:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100290.592801:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790100290.592817:0:6685:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790100290.605295:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100290.605486:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790100290.605756:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100290.606135:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790100290.606351:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100290.606582:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790100290.607817:0:6685:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1790100290.793517:0:6685:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790100290.793524:0:6685:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790100290.793560:0:6685:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790100290.793701:0:6685:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790100290.793719:0:6685:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790100290.793747:0:6685:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1790100290.854711:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100291.877796:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790100292.582912:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790100292.582921:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6788844800 from 21 10000000:01000000:3.0:1790100292.582928:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790100292.582980:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100292.582992:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100292.583003:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100292.583027:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126197760:0@lo:101: 00000100:00100000:3.0:1790100292.583099:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100292.583154:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.583177:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126197760 00000100:00100000:0.0:1790100292.583187:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126197760 00000100:00100000:0.0:1790100292.583244:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790100292.583254:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+11:5838:x1877056126197760:12345-0@lo:101: 00010000:00010000:0.0:1790100292.583266:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100292.583279:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcd50 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.583301:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd50 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.583311:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd50 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.583333:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780030800, rc 0) 00000100:00100000:0.0:1790100292.583385:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126197760:12345-0@lo:101: Request processed in 132us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.583392:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790100292.583595:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126197760:0@lo:101: 00010000:00010000:3.0:1790100292.583628:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100292.583639:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100292.583704:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126197888:0@lo:501: 00000100:00100000:3.0:1790100292.583728:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100292.583747:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c480 going to sleep for 11 seconds 00000100:00100000:1.0:1790100292.583787:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126197888 00000100:00100000:1.0:1790100292.583800:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126197888 00000100:00100000:1.0:1790100292.583836:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790100292.583855:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126197888:12345-0@lo:501: 00000100:00100000:1.0:1790100292.584207:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126197888:12345-0@lo:501: Request processed in 354us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100292.584215:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100292.584280:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126197888:0@lo:501: 00000100:00100000:2.0:1790100292.584309:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198016:0@lo:503: 00000100:00100000:2.0:1790100292.584358:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100292.584380:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad458cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.584424:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126198016 00000100:00100000:0.0:1790100292.584428:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126198016 00000100:00100000:0.0:1790100292.584457:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790100292.584464:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126198016:12345-0@lo:503: 00000100:00100000:0.0:1790100292.584753:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126198016:12345-0@lo:503: Request processed in 291us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.584758:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790100292.584787:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198016:0@lo:503: 00000100:00100000:0.0:1790100292.584922:0:6831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6831:1877056126198144:0@lo:502: 00000100:00100000:0.0:1790100292.584946:0:6831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.584959:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126198144 00000100:00100000:0.0:1790100292.584962:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126198144 00000100:00100000:0.0:1790100292.584973:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790100292.584977:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6831:x1877056126198144:12345-0@lo:502: 00000100:00100000:0.0:1790100292.585115:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6831:x1877056126198144:12345-0@lo:502: Request processed in 137us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.585120:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790100292.585139:0:6831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.585147:0:6831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6831:1877056126198144:0@lo:502: 00000100:00100000:0.0:1790100292.585173:0:6831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6831:1877056126198272:0@lo:502: 00000100:00100000:0.0:1790100292.585200:0:6831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.585212:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126198272 00000100:00100000:0.0:1790100292.585214:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126198272 00000100:00100000:0.0:1790100292.585224:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790100292.585228:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6831:x1877056126198272:12345-0@lo:502: 00000100:00100000:0.0:1790100292.585298:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:6831:x1877056126198272:12345-0@lo:502: Request processed in 70us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.585303:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790100292.585319:0:6831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.585326:0:6831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6831:1877056126198272:0@lo:502: 00000040:00080000:0.0:1790100292.585338:0:6831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1790100292.585380:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1790100292.585394:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100292.585401:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.585408:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100292.585414:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790100292.585415:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6788844800 from 4 10000000:01000000:0.0:1790100292.585417:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100292.585434:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.585439:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.585445:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100292.585456:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198400:0@lo:101: 00000100:00100000:0.0:1790100292.585474:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.585482:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.585490:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126198400 00000100:00100000:0.0:1790100292.585493:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126198400 00000100:00100000:0.0:1790100292.585503:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790100292.585507:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126198400:12345-0@lo:101: 00010000:00010000:0.0:1790100292.585512:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100292.585521:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcd5e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.585534:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd5e expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.585540:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd5e expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.585546:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780030e00, rc 0) 00000100:00100000:0.0:1790100292.585562:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126198400:12345-0@lo:101: Request processed in 55us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.585565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790100292.585581:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198400:0@lo:101: 00010000:00010000:0.0:1790100292.585588:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.585593:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100292.585824:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198528:0@lo:256: 00000100:00100000:0.0:1790100292.585845:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.585892:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100292.585967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126198528 00000100:00100000:2.0:1790100292.585971:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126198528 00000100:00100000:2.0:1790100292.586019:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790100292.586024:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126198528:12345-0@lo:256: 20000000:01000000:2.0:1790100292.586034:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790100292.586052:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790100292.586055:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1790100292.586131:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126198528:12345-0@lo:256: Request processed in 107us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100292.586136:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790100292.586181:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198528:0@lo:256: 10000000:01000000:0.0:1790100292.586223:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790100292.586227:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.586233:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100292.586237:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790100292.586238:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1790100292.586240:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790100292.586250:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.586255:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.586260:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100292.586266:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198656:0@lo:101: 00000100:00100000:0.0:1790100292.586282:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.586297:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100292.586325:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126198656 00000100:00100000:2.0:1790100292.586328:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126198656 00000100:00100000:2.0:1790100292.586339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790100292.586343:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126198656:12345-0@lo:101: 00010000:00010000:2.0:1790100292.586349:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100292.586357:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcd6c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100292.586370:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd6c expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100292.586378:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd6c expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100292.586383:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781656200, rc 0) 00000100:00100000:2.0:1790100292.586415:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126198656:12345-0@lo:101: Request processed in 72us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100292.586420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790100292.586463:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198656:0@lo:101: 00010000:00010000:0.0:1790100292.586475:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.586480:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100292.586505:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198784:0@lo:501: 00000100:00100000:0.0:1790100292.586520:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.586535:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100292.586562:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126198784 00000100:00100000:2.0:1790100292.586565:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126198784 00000100:00100000:2.0:1790100292.586576:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790100292.586579:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126198784:12345-0@lo:501: 00000100:00100000:2.0:1790100292.586799:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126198784:12345-0@lo:501: Request processed in 217us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100292.586809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790100292.586875:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198784:0@lo:501: 00000100:00100000:0.0:1790100292.586892:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198912:0@lo:503: 00000100:00100000:0.0:1790100292.586915:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.586936:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100292.586953:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126198912 00000100:00100000:3.0:1790100292.586957:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126198912 00000100:00100000:3.0:1790100292.586990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790100292.586997:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126198912:12345-0@lo:503: 00000100:00100000:3.0:1790100292.587231:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126198912:12345-0@lo:503: Request processed in 234us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100292.587237:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790100292.587250:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126198912:0@lo:503: 00000100:00100000:3.0:1790100292.587527:0:6832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6832:1877056126199040:0@lo:502: 00000100:00100000:3.0:1790100292.587552:0:6832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100292.587567:0:6832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.587581:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126199040 00000100:00100000:0.0:1790100292.587584:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126199040 00000100:00100000:3.0:1790100292.587636:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790100292.587653:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:6832:x1877056126199040:12345-0@lo:502: 00000100:00100000:3.0:1790100292.587825:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:6832:x1877056126199040:12345-0@lo:502: Request processed in 182us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100292.587832:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790100292.587852:0:6832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6832:1877056126199040:0@lo:502: 00000020:01000000:2.0:1790100292.587873:0:6832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790100292.587880:0:6832:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790100292.587886:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100292.587888:0:6832:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790100292.587896:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790100292.587900:0:6832:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:2.0:1790100292.587916:0:6832:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790100292.587918:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790100292.587931:0:6832:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d6787ce99c0) 00000020:00000080:2.0:1790100292.587947:0:6832:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1790100292.587951:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790100292.588002:0:6832:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790100292.588006:0:6832:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790100292.588011:0:6832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefcd81 00010000:00080000:2.0:1790100292.588031:0:6832:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d67aee72800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:2.0:1790100292.588207:0:6832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1790100292.620349:0:6832:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790100292.620374:0:6832:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790100292.621075:0:6832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100292.621271:0:6832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100292.621328:0:6832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1790100292.621389:0:6832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1790100292.624264:0:6833:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100292.624272:0:6833:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790100292.624845:0:6832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790100292.624854:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790100292.624879:0:6832:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790100292.624894:0:6832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefcd88 00000100:00080000:0.0:1790100292.624903:0:6832:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100292.624914:0:6832:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d67aee72800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100292.624943:0:6832:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67ad887480 x1877056126199168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100292.624974:0:6832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1790100292.625043:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126199168:0@lo:8: 00000020:01000000:0.0:1790100292.625062:0:6832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100292.625068:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100292.625070:0:6832:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790100292.625073:0:6832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100292.625079:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100292.625081:0:6832:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790100292.625084:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790100292.625087:0:6832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790100292.625112:0:6832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6832:1877056126199296:0@lo:502: 00000100:00100000:2.0:1790100292.625119:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100292.625242:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126199424:0@lo:400: 00000100:00100000:3.0:1790100292.625305:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126199168 00000100:00100000:3.0:1790100292.625310:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126199168 00000100:00100000:2.0:1790100292.625325:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126199552:0@lo:400: 00000100:00100000:3.0:1790100292.625337:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100292.625354:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1877056126199168:12345-0@lo:8: 00000100:00100000:0.0:1790100292.625383:0:6832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.625398:0:6832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf8189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.625411:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126199296 00000100:00100000:0.0:1790100292.625413:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126199296 00000100:00100000:0.0:1790100292.625433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790100292.625437:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:6832:x1877056126199296:12345-0@lo:502: 00000100:00100000:0.0:1790100292.625629:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:6832:x1877056126199296:12345-0@lo:502: Request processed in 191us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.625635:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790100292.625684:0:6832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6832:1877056126199296:0@lo:502: 00000020:01000000:0.0:1790100292.625704:0:6832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100292.625706:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100292.625707:0:6832:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790100292.625710:0:6832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1790100292.625787:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1790100292.625799:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790100292.625805:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.625821:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100292.625827:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100292.625829:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6788844800 from 1 10000000:01000000:0.0:1790100292.625831:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100292.625848:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.625853:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.625859:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100292.625866:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126199680:0@lo:101: 00000100:00100000:0.0:1790100292.625883:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.625894:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf8189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.625904:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126199680 00000100:00100000:0.0:1790100292.625906:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126199680 00000100:00100000:0.0:1790100292.625918:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790100292.625922:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126199680:12345-0@lo:101: 00010000:00010000:0.0:1790100292.625928:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100292.625937:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcd8f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.625951:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd8f expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.625966:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd8f expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.625971:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780030600, rc 0) 00000100:00100000:0.0:1790100292.625990:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126199680:12345-0@lo:101: Request processed in 68us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.625994:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790100292.626012:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126199680:0@lo:101: 00010000:00010000:0.0:1790100292.626020:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.626026:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100292.626054:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126199808:0@lo:501: 00000100:00100000:0.0:1790100292.626074:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.626085:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf8189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.626095:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126199808 00000100:00100000:0.0:1790100292.626098:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126199808 00000100:00100000:0.0:1790100292.626112:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100292.626115:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126199808:12345-0@lo:501: 00000100:00100000:0.0:1790100292.626273:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126199808:12345-0@lo:501: Request processed in 156us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.626277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100292.626296:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126199808:0@lo:501: 00000100:00100000:0.0:1790100292.626311:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126199936:0@lo:503: 00000100:00100000:0.0:1790100292.626335:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.626344:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.626351:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126199936 00000100:00100000:0.0:1790100292.626354:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126199936 00000100:00100000:0.0:1790100292.626364:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790100292.626367:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126199936:12345-0@lo:503: 00000100:00100000:0.0:1790100292.626600:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126199936:12345-0@lo:503: Request processed in 231us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.626607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790100292.626681:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126199936:0@lo:503: 00000100:00100000:0.0:1790100292.626808:0:6835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6835:1877056126200064:0@lo:502: 00000100:00100000:0.0:1790100292.626831:0:6835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.626844:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126200064 00000100:00100000:0.0:1790100292.626846:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126200064 00000100:00100000:0.0:1790100292.626859:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790100292.626863:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:6835:x1877056126200064:12345-0@lo:502: 00000100:00100000:0.0:1790100292.626945:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:6835:x1877056126200064:12345-0@lo:502: Request processed in 81us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.626949:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790100292.626967:0:6835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e2540 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.626974:0:6835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6835:1877056126200064:0@lo:502: 00000020:01000000:0.0:1790100292.626987:0:6835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100292.626991:0:6835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100292.626993:0:6835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790100292.626997:0:6835:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6788844800 00000020:00000080:0.0:1790100292.626998:0:6835:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790100292.627022:0:6835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6835:1877056126200192:0@lo:502: 00000100:00100000:0.0:1790100292.627047:0:6835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.627065:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126200192 00000100:00100000:0.0:1790100292.627068:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126200192 00000100:00100000:0.0:1790100292.627086:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790100292.627092:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:6835:x1877056126200192:12345-0@lo:502: 00000100:00100000:0.0:1790100292.627161:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:6835:x1877056126200192:12345-0@lo:502: Request processed in 70us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.627166:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790100292.627185:0:6835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e2540 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.627194:0:6835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:6835:1877056126200192:0@lo:502: 00000020:01000000:0.0:1790100292.627210:0:6835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100292.627214:0:6835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100292.627216:0:6835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790100292.627219:0:6835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1790100292.627250:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790100292.627260:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100292.627265:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.627271:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100292.627276:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790100292.627277:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d6784edb380 from 1 10000000:01000000:0.0:1790100292.627279:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790100292.627291:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.627296:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.627306:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100292.627313:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126200320:0@lo:101: 00000100:00100000:0.0:1790100292.627329:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.627337:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e2540 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.627345:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126200320 00000100:00100000:0.0:1790100292.627347:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126200320 00000100:00100000:0.0:1790100292.627359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790100292.627362:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126200320:12345-0@lo:101: 00010000:00010000:0.0:1790100292.627367:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100292.627374:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcd9d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.627384:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd9d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.627389:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd9d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.627394:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780031c00, rc 0) 00000100:00100000:0.0:1790100292.627410:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126200320:12345-0@lo:101: Request processed in 48us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.627414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790100292.627430:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126200320:0@lo:101: 00010000:00010000:0.0:1790100292.627438:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100292.627450:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100292.627474:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126200448:0@lo:501: 00000100:00100000:0.0:1790100292.627489:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.627496:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e2540 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.627504:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126200448 00000100:00100000:0.0:1790100292.627507:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126200448 00000100:00100000:0.0:1790100292.627524:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100292.627530:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126200448:12345-0@lo:501: 00000100:00100000:0.0:1790100292.627680:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126200448:12345-0@lo:501: Request processed in 149us (189us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100292.627691:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100292.627719:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126200448:0@lo:501: 10000000:01000000:0.0:1790100292.627734:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790100292.627739:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790100292.627746:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00010000:00010000:0.0:1790100292.627746:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1790100292.627774:0:6687:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefcdab 00002000:00100000:3.0:1790100292.627814:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d67bf546000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790100292.627818:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1790100292.627823:0:6687:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790100292.627919:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790100292.628075:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790100292.628104:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d67bf543000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100292.628150:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1877056126199168:12345-0@lo:8: Request processed in 2806us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100292.628164:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790100292.628234:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67ad887480 x1877056126199168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100292.628242:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100292.628248:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790100292.628253:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790100292.628257:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790100292.628259:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67aee72800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790100292.628274:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790100292.628279:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126199168:0@lo:8: 00000004:00080000:3.0:1790100292.628299:0:6833:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790100292.628375:0:6833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 189197763397ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790100292.629582:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100292.629665:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126199552 00000100:00100000:1.0:1790100292.629673:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126199552 00000100:00080000:2.0:1790100292.629718:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100292.629732:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100292.629742:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126199552:12345-0@lo:400: 00000100:00100000:1.0:1790100292.629798:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126199552:12345-0@lo:400: Request processed in 59us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100292.629805:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790100292.629902:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b152300 x1877056126199552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100292.629918:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126199552:0@lo:400: 00000100:00100000:1.0:1790100292.630120:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100292.630204:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126199424 00000100:00100000:3.0:1790100292.630209:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126199424 00000100:00100000:3.0:1790100292.630240:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100292.630247:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126199424:12345-0@lo:400: 00000100:00100000:3.0:1790100292.630297:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126199424:12345-0@lo:400: Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100292.630304:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790100292.630317:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b150000 x1877056126199424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100292.630335:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126199424:0@lo:400: 00000004:00080000:0.0:1790100292.654291:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790100292.654421:0:6834:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790100292.654434:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100292.654454:0:6834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6834:1877056126200704:0@lo:7: 00000100:00100000:2.0:1790100292.654454:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126200576:0@lo:13: 00000100:00100000:3.0:1790100292.654706:0:6834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100292.654766:0:6834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100292.654779:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126200704 00000100:00100000:1.0:1790100292.654788:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126200704 00000100:00100000:1.0:1790100292.654860:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790100292.654866:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100292.654871:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6834:x1877056126200704:12345-0@lo:7: 00000100:00100000:2.0:1790100292.658293:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100292.658663:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126200576 00000100:00100000:3.0:1790100292.658673:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126200576 00000100:00100000:3.0:1790100292.658748:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100292.658761:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877056126200576:12345-0@lo:13: 00002000:00000024:3.0:1790100292.658794:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1790100292.658860:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877056126200576:12345-0@lo:13: Request processed in 105us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100292.658868:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790100292.658921:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b152d80 x1877056126200576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100292.658942:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126200576:0@lo:13: 00002000:00080000:1.0:1790100292.660353:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1790100292.660360:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1790100292.660442:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6834:x1877056126200704:12345-0@lo:7: Request processed in 5572us (5734us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100292.660451:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790100292.660723:0:6834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b150700 x1877056126200704/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790100308 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100292.660748:0:6834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6834:1877056126200704:0@lo:7: 00000004:00080000:3.0:1790100292.660762:0:6834:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790100292.660798:0:6834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6834:1877056126200832:0@lo:5: 00000100:00100000:3.0:1790100292.660840:0:6834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100292.660871:0:6834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.661098:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126200832 00000100:00100000:0.0:1790100292.661105:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126200832 00000100:00100000:0.0:1790100292.661143:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100292.661151:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6834:x1877056126200832:12345-0@lo:5: 00002000:00080000:0.0:1790100292.661182:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1790100292.661185:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1790100292.661412:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6834:x1877056126200832:12345-0@lo:5: Request processed in 262us (572us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790100292.661419:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790100292.661651:0:6834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b150700 x1877056126200832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100308 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100292.661677:0:6834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6834:1877056126200832:0@lo:5: 00000004:00080000:1.0:1790100292.661688:0:6834:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790100292.661716:0:6834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6834:1877056126200960:0@lo:700: 00000100:00100000:1.0:1790100292.661744:0:6834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100292.661763:0:6834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100292.661795:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126200960 00000100:00100000:0.0:1790100292.661801:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126200960 00000100:00100000:0.0:1790100292.661838:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100292.661846:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6834:x1877056126200960:12345-0@lo:700: 00000100:00100000:0.0:1790100292.661876:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1877056126201088:0@lo:700: 00000100:00100000:0.0:1790100292.661909:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100292.661941:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e2540 going to sleep for 11 seconds 00000100:00100000:3.0:1790100292.661968:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126201088 00000100:00100000:3.0:1790100292.661973:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126201088 00000100:00100000:3.0:1790100292.662039:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100292.662046:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1877056126201088:12345-0@lo:700: 40000000:02000000:3.0:1790100292.715672:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1790100292.721214:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1877056126201088:12345-0@lo:700: Request processed in 59162us (59298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100292.721228:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790100292.721365:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67ad886d80 x1877056126201088/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790100308 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100292.721380:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1877056126201088:0@lo:700: 40000000:02000000:0.0:1790100292.721393:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1790100292.815531:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6834:x1877056126200960:12345-0@lo:700: Request processed in 153676us (153776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100292.815546:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790100292.815663:0:6834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67ad87f100 x1877056126200960/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790100308 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100292.815680:0:6834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6834:1877056126200960:0@lo:700: 00000001:00080000:3.0:1790100292.816213:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1790100292.816230:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1790100292.858816:0:6834:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1790100292.862781:0:6834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6834:1877056126201216:0@lo:5: 00000100:00100000:3.0:1790100292.862846:0:6834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100292.862987:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126201216 00000100:00100000:2.0:1790100292.862995:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126201216 00000100:00100000:2.0:1790100292.863045:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100292.863054:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6834:x1877056126201216:12345-0@lo:5: 00000100:00100000:3.0:1790100292.872189:0:6834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c300 going to sleep for 11 seconds 00002000:00080000:2.0:1790100292.878481:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1790100292.878501:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1790100292.888543:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6834:x1877056126201216:12345-0@lo:5: Request processed in 25482us (25689us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790100292.888557:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790100292.888676:0:6834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b153100 x1877056126201216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100308 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100292.888691:0:6834:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790100292.888708:0:6834:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d678b153100 x1877056126201216/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100308 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100292.888719:0:6834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6834:1877056126201216:0@lo:5: 00000004:00080000:3.0:1790100292.888733:0:6834:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1790100292.903044:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100293.926415:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100294.949789:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790100295.828049:0:7058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790100295.977693:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100296.997791:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100297.958087:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100297.958113:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126201344:0@lo:13: 00000100:00100000:0.0:1790100297.958181:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.958271:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126201344 00000100:00100000:0.0:1790100297.958279:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126201344 00000100:00100000:0.0:1790100297.958325:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100297.958333:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126201344:12345-0@lo:13: 00002000:00000024:0.0:1790100297.958372:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100297.958412:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad885c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126201344:12345-0@lo:13: Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.958418:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790100297.958437:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790100297.958463:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67ad886d80 x1877056126201344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100297.958481:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126201344:0@lo:13: 00000100:00100000:0.0:1790100297.959312:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126201600:0@lo:400: 00000100:00100000:0.0:1790100297.959351:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.959391:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100297.959397:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126201472:0@lo:400: 00000100:00100000:0.0:1790100297.959425:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100297.959457:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126201472 00000100:00100000:0.0:1790100297.959462:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126201472 00000100:00100000:0.0:1790100297.959489:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790100297.959495:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3312:x1877056126201472:12345-0@lo:400: 00000100:00100000:0.0:1790100297.959530:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3312:x1877056126201472:12345-0@lo:400: Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100297.959537:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790100297.959581:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126201472:0@lo:400: 00000100:00100000:0.0:1790100297.959627:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126201728:0@lo:400: 00000100:00100000:0.0:1790100297.959661:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100297.959897:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126201600 00000100:00100000:2.0:1790100297.959902:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126201600 00000100:00100000:2.0:1790100297.959935:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126201728 00000100:00100000:2.0:1790100297.959938:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126201728 00000100:00100000:2.0:1790100297.959962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100297.959968:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126201600:12345-0@lo:400: 00000100:00100000:2.0:1790100297.960007:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126201600:12345-0@lo:400: Request processed in 38us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.960013:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100297.960026:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790100297.960032:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126201728:12345-0@lo:400: 00000100:00100000:2.0:1790100297.960066:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126201728:12345-0@lo:400: Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100297.960081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790100297.960311:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790100297.960332:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6787b83800 x1877056126201600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100297.960343:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126201600:0@lo:400: 00010000:00080000:0.0:1790100297.960431:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6787b81880 x1877056126201728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100297.960440:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126201728:0@lo:400: 00010000:00010000:1.0:1790100298.021730:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790100298.024848:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1790100299.050605:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100300.069751:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100301.096986:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100302.117870:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100303.077732:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126201984:0@lo:400: 00000100:00100000:0.0:1790100303.077732:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126201856:0@lo:13: 00000100:00100000:1.0:1790100303.077825:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100303.077825:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100303.077896:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126201984 00000100:00100000:2.0:1790100303.077905:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126201984 00000100:00100000:2.0:1790100303.077955:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790100303.077966:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3314:x1877056126201984:12345-0@lo:400: 00000100:00100000:0.0:1790100303.078104:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100303.078113:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126202112:0@lo:400: 00000100:00100000:0.0:1790100303.078147:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100303.078187:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3314:x1877056126201984:12345-0@lo:400: Request processed in 223us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100303.078196:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790100303.078238:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126201856 00000100:00100000:2.0:1790100303.078242:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126201856 00000100:00100000:2.0:1790100303.078281:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100303.078288:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126201856:12345-0@lo:13: 00002000:00000024:2.0:1790100303.078316:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100303.078346:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126201856:12345-0@lo:13: Request processed in 59us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100303.078364:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790100303.078549:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126201984:0@lo:400: 00000100:00100000:1.0:1790100303.078571:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126202368:0@lo:400: 00000100:00100000:1.0:1790100303.078597:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100303.078692:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100303.078699:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126202240:0@lo:400: 00000100:00100000:2.0:1790100303.078770:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126202368 00000100:00100000:2.0:1790100303.078775:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126202368 00000100:00100000:2.0:1790100303.078806:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100303.078813:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126202368:12345-0@lo:400: 00000100:00100000:2.0:1790100303.078852:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126202368:12345-0@lo:400: Request processed in 39us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100303.078858:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790100303.079076:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67ad884a80 x1877056126201856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100303.079096:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790100303.079117:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126201856:0@lo:13: 00000100:00080000:2.0:1790100303.079708:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100303.079708:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126202112 00000100:00100000:0.0:1790100303.079716:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126202112 00000100:00100000:0.0:1790100303.079757:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100303.079767:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126202112:12345-0@lo:400: 00000100:00100000:0.0:1790100303.079828:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126202112:12345-0@lo:400: Request processed in 62us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100303.079835:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790100303.079853:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6787b81880 x1877056126202112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100303.079874:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100303.079883:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126202112:0@lo:400: 00010000:00080000:0.0:1790100303.079918:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6787b83b80 x1877056126202368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100303.079930:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126202368:0@lo:400: 00000100:00100000:0.0:1790100303.079954:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126202240 00000100:00100000:0.0:1790100303.079958:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126202240 00000100:00100000:0.0:1790100303.079998:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790100303.080005:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126202240:12345-0@lo:400: 00000100:00100000:0.0:1790100303.080044:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126202240:12345-0@lo:400: Request processed in 41us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100303.080050:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790100303.080074:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d6787b83800 x1877056126202240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100303.080081:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126202240:0@lo:400: 00000100:00080000:2.0:1790100303.080120:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790100303.147597:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100304.174845:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790100304.933826:0:7632:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790100304.933829:0:7632:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790100304.933924:0:7632:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d6787677800 00000020:01000004:2.0:1790100304.933937:0:7632:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790100304.933946:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790100304.933955:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d6787ce8000) 00000020:00000080:2.0:1790100304.933967:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790100304.941787:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790100304.941950:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790100304.951896:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790100304.954252:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790100304.954273:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790100304.954305:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790100304.954328:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790100304.954607:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790100304.954703:0:7632:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790100304.954713:0:7632:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x31a8f3fdeeefcdb9 00000020:01000004:2.0:1790100304.954722:0:7632:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790100304.954741:0:7632:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790100304.954744:0:7632:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790100304.954748:0:7632:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790100304.954764:0:7632:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790100304.954767:0:7632:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790100304.963365:0:7632:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790100304.963393:0:7632:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.118@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1790100304.963396:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790100304.963399:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790100304.963400:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100304.963401:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100304.963401:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100304.963402:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100304.963403:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100304.963404:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100304.963405:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100304.963406:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100304.963407:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100304.963409:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1790100304.963411:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100304.963411:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790100304.963412:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100304.963413:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100304.963413:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100304.963414:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100304.963415:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100304.963415:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790100304.963416:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790100304.963416:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100304.963417:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100304.963454:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790100304.963472:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126202496:0@lo:253: 00000100:00100000:2.0:1790100304.963533:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100304.963699:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100304.963752:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126202496 00000100:00100000:0.0:1790100304.963759:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126202496 00000100:00100000:0.0:1790100304.963799:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790100304.963805:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:7632:x1877056126202496:12345-0@lo:253: 20000000:01000000:0.0:1790100304.963835:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790100304.963838:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1790100304.963842:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1790100304.963844:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1790100304.964467:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100304.964630:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1790100304.964641:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1790100304.964666:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1790100304.964673:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1790100304.964701:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1790100304.964752:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1790100304.964990:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1790100304.965002:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:0.0:1790100304.965004:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:0.0:1790100304.965021:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1790100304.965026:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790100304.965050:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1790100304.965054:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:0.0:1790100304.965069:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1790100304.965074:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790100304.965088:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1790100304.965112:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1790100304.965672:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1790100304.965686:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.118@tcp 20000000:01000000:0.0:1790100304.965688:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.118@tcp (null) (null) (null) 00000040:00080000:0.0:1790100304.965723:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1790100304.965730:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790100304.965758:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1790100304.965765:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.118@tcp (null) (null) 00000040:00080000:0.0:1790100304.965794:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1790100304.965801:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790100304.965841:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1790100304.965890:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1790100304.965906:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1790100304.965909:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1790100304.965914:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790100304.965916:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790100304.965918:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790100304.965930:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790100304.965933:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790100304.965958:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1790100304.965960:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790100304.966461:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1790100304.966734:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1790100304.966758:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1790100304.966790:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1790100304.966799:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790100304.966800:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790100304.967069:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1790100304.967097:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1790100304.967125:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1790100304.967259:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1790100304.967279:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1790100304.967306:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1790100304.967312:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790100304.967314:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790100304.967596:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1790100304.967719:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1790100304.967762:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1790100304.967924:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1790100304.967952:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1790100304.967969:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1790100304.967975:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790100304.967977:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790100304.968329:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1790100304.968364:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1790100304.968381:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1790100304.968551:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1790100304.968572:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1790100304.968597:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1790100304.968693:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790100304.968713:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968731:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefcd03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefccfc expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968737:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd26 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968741:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd50 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968745:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd6c expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968749:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd9d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968753:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968783:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcd9d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968793:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd9d expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.968809:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126202624:0@lo:104: 00000100:00100000:2.0:1790100304.968862:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100304.968925:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcd6c expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968930:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd6c expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.968936:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126202752:0@lo:104: 00010000:00010000:2.0:1790100304.968961:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcd50 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968966:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd50 expref: 16 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.968970:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b82d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126202880:0@lo:104: 00010000:00010000:2.0:1790100304.968981:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcd26 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.968985:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd26 expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.968990:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b82300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126203008:0@lo:104: 00010000:00010000:2.0:1790100304.968999:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefcd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefccfc expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.969003:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefcd03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefccfc expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.969015:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126203136:0@lo:104: 00000100:00100000:2.0:1790100304.969026:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b27589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100304.969061:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790100304.969074:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100304.969119:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100304.969154:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.969167:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126202624 00000100:00100000:1.0:1790100304.969172:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126202624 00000100:00100000:1.0:1790100304.969196:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126202752 00000100:00100000:1.0:1790100304.969198:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126202752 00000100:00100000:1.0:1790100304.969208:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126202880 00000100:00100000:1.0:1790100304.969210:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126202880 00000100:00100000:1.0:1790100304.969218:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100304.969223:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67857b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+5:5836:x1877056126202624:12345-0@lo:104: 00010000:00010000:1.0:1790100304.969232:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969281:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100304.969285:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67857b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+5:5836:x1877056126202624:12345-0@lo:104: Request processed in 62us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.969290:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100304.969315:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100304.969318:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:5836:x1877056126202752:12345-0@lo:104: 00010000:00010000:1.0:1790100304.969323:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969343:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790100304.969346:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:5836:x1877056126202752:12345-0@lo:104: Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.969349:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100304.969356:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100304.969359:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5836:x1877056126202880:12345-0@lo:104: 00010000:00010000:1.0:1790100304.969363:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969376:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790100304.969379:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5836:x1877056126202880:12345-0@lo:104: Request processed in 21us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.969389:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790100304.969400:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790100304.969404:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969409:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780031400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100304.969411:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969417:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100304.969421:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100304.969424:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100304.969460:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969467:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100304.969484:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969490:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6780031400/0x31a8f3fdeeefcd9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969502:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100304.969504:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969515:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780031600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100304.969517:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969521:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100304.969524:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100304.969527:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100304.969536:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969540:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100304.969543:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969547:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6780031600/0x31a8f3fdeeefcd6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969552:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100304.969554:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969557:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100304.969559:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969568:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100304.969572:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100304.969574:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100304.969580:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969583:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100304.969592:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969596:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781523600/0x31a8f3fdeeefcd50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969602:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100304.969603:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100304.969604:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100304.969640:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126203264:0@lo:103: 00000100:00100000:1.0:1790100304.969659:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.969676:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100304.969682:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126203392:0@lo:103: 00000100:00100000:1.0:1790100304.969699:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.969724:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126203520:0@lo:103: 00000100:00100000:1.0:1790100304.969741:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.969762:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126203264 00000100:00100000:1.0:1790100304.969769:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126203264 00010000:00010000:1.0:1790100304.969783:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd9d expref: 17 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100304.969792:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126203392 00000100:00100000:1.0:1790100304.969794:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126203392 00010000:00010000:1.0:1790100304.969798:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd6c expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100304.969803:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126203520 00000100:00100000:1.0:1790100304.969805:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126203520 00010000:00010000:1.0:1790100304.969809:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd50 expref: 19 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100304.969815:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100304.969818:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126203264:12345-0@lo:103: 00010000:00010000:1.0:1790100304.969825:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100304.969828:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd9d expref: 19 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969834:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd9d expref: 19 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969845:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100304.969863:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126203264:12345-0@lo:103: Request processed in 44us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.969866:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100304.969873:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100304.969877:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:3311:x1877056126203392:12345-0@lo:103: 00010000:00010000:1.0:1790100304.969881:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100304.969889:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd6c expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969894:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd6c expref: 18 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969900:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100304.969914:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:3311:x1877056126203392:12345-0@lo:103: Request processed in 37us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.969917:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100304.969925:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100304.969928:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3313:x1877056126203520:12345-0@lo:103: 00010000:00010000:1.0:1790100304.969932:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100304.969934:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd50 expref: 17 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969939:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd50 expref: 17 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.969944:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100304.969957:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3313:x1877056126203520:12345-0@lo:103: Request processed in 29us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.969960:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100304.969984:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126203520:0@lo:103: 00000100:00100000:1.0:1790100304.969997:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126203392:0@lo:103: 00000100:00100000:1.0:1790100304.970001:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126203264:0@lo:103: 00010000:00010000:3.0:1790100304.970067:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100304.970151:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780031c00/0x31a8f3fdeeefcda4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd9d expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.970158:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126202624:0@lo:104: 00010000:00010000:2.0:1790100304.970162:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefcd73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd6c expref: 15 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.970168:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126202752:0@lo:104: 00010000:00010000:2.0:1790100304.970172:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780030800/0x31a8f3fdeeefcd57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd50 expref: 14 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.970177:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b82d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126202880:0@lo:104: 00000100:00100000:0.0:1790100304.970260:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.970301:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126203008 00000100:00100000:1.0:1790100304.970305:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126203008 00000100:00100000:1.0:1790100304.970320:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126203136 00000100:00100000:1.0:1790100304.970321:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126203136 00000100:00100000:1.0:1790100304.970327:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100304.970331:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:5836:x1877056126203008:12345-0@lo:104: 00010000:00010000:1.0:1790100304.970336:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970396:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100304.970400:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:5836:x1877056126203008:12345-0@lo:104: Request processed in 69us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.970404:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100304.970411:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790100304.970415:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5836:x1877056126203136:12345-0@lo:104: 00010000:00010000:1.0:1790100304.970420:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6781523e00/0x31a8f3fdeeefccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970455:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790100304.970459:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5836:x1877056126203136:12345-0@lo:104: Request processed in 44us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.970465:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1790100304.970477:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100304.970482:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970488:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781657a00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100304.970492:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970499:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100304.970507:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100304.970511:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100304.970526:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970530:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100304.970535:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970540:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781657a00/0x31a8f3fdeeefcd26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd2d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970545:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100304.970547:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6781523e00/0x31a8f3fdeeefccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970550:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523e00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100304.970552:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6781523e00/0x31a8f3fdeeefccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970556:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781523e00/0x31a8f3fdeeefccfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100304.970560:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781523e00/0x31a8f3fdeeefccfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100304.970562:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100304.970572:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6781523e00/0x31a8f3fdeeefccfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970576:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100304.970581:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6781523e00/0x31a8f3fdeeefccfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970585:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781523e00/0x31a8f3fdeeefccfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd03 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970592:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100304.970593:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100304.970594:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100304.970601:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126203648:0@lo:103: 00000100:00100000:1.0:1790100304.970632:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.970654:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100304.970659:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126203776:0@lo:103: 00000100:00100000:1.0:1790100304.970672:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.970694:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126203648 00000100:00100000:1.0:1790100304.970697:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126203648 00010000:00010000:1.0:1790100304.970711:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd26 expref: 14 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100304.970726:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126203776 00000100:00100000:1.0:1790100304.970729:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126203776 00010000:00010000:1.0:1790100304.970738:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefcd03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefccfc expref: 15 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100304.970746:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100304.970749:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+15:3314:x1877056126203648:12345-0@lo:103: 00010000:00010000:1.0:1790100304.970759:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100304.970762:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd26 expref: 15 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970768:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd26 expref: 15 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970775:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100304.970792:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+15:3314:x1877056126203648:12345-0@lo:103: Request processed in 43us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.970796:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100304.970804:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790100304.970807:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:3312:x1877056126203776:12345-0@lo:103: 00010000:00010000:1.0:1790100304.970811:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100304.970814:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefcd03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefccfc expref: 14 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970819:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefcd03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefccfc expref: 14 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970826:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970832:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970840:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970844:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970853:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970857:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970860:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781657600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100304.970862:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970866:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970872:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.970878:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100304.970895:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:3312:x1877056126203776:12345-0@lo:103: Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100304.970899:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790100304.970919:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126203776:0@lo:103: 00000100:00100000:1.0:1790100304.970929:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126203648:0@lo:103: 00010000:00010000:3.0:1790100304.970972:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100304.971066:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefcd2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd26 expref: 13 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.971073:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b82300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126203008:0@lo:104: 00010000:00010000:2.0:1790100304.971078:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefcd03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefccfc expref: 12 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.971083:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1877056126203136:0@lo:104: 00010000:00010000:2.0:1790100304.971098:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.971104:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.971113:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.971117:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781657600/0x31a8f3fdeeefcdc0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790100304.971125:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790100304.994414:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+11:7632:x1877056126202496:12345-0@lo:253: Request processed in 30600us (30871us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100304.994430:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126202496:0@lo:253: 00000100:00100000:0.0:1790100304.994446:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 10000000:01000000:2.0:1790100304.994455:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790100304.994458:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790100304.994460:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790100304.994461:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100304.994462:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1790100304.994464:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100304.994465:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100304.994466:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100304.994468:0:7632:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790100304.994469:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100304.994471:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790100304.994488:0:7632:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d6787677800 from lustre-OST0001 10000000:01000000:2.0:1790100304.994509:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790100304.994512:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790100304.994521:0:7632:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d6784edb380 local copy 10000000:01000000:2.0:1790100304.994524:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790100304.994557:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.994567:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.994575:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.994605:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126203904:0@lo:101: 00000100:00100000:2.0:1790100304.994654:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100304.994683:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100304.994685:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126203904 00000100:00100000:0.0:1790100304.994691:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126203904 00000100:00100000:0.0:1790100304.994726:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790100304.994736:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+11:7632:x1877056126203904:12345-0@lo:101: 00010000:00010000:0.0:1790100304.994747:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100304.994759:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf531000/0x31a8f3fdeeefcdce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcdc7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100304.994781:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf531000/0x31a8f3fdeeefcdce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdc7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100304.994792:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf531000/0x31a8f3fdeeefcdce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdc7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100304.994812:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf531000, rc 0) 00000100:00100000:0.0:1790100304.994843:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126203904:12345-0@lo:101: Request processed in 109us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100304.994849:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790100304.994851:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126203904:0@lo:101: 00010000:00010000:2.0:1790100304.994862:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.994872:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.994950:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204032:0@lo:501: 00000100:00100000:2.0:1790100304.994967:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100304.994983:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100304.994997:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126204032 00000100:00100000:0.0:1790100304.995001:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126204032 00000100:00100000:0.0:1790100304.995023:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790100304.995028:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126204032:12345-0@lo:501: 00000100:00100000:0.0:1790100304.995184:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126204032:12345-0@lo:501: Request processed in 155us (214us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100304.995191:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790100304.995192:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204032:0@lo:501: 10000000:01000000:2.0:1790100304.995203:0:7632:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790100304.995224:0:7632:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790100304.995229:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.995237:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.995245:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.995265:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790100304.995282:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d6787677800 10000000:01000000:2.0:1790100304.995285:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790100304.995288:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790100304.995290:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790100304.995293:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790100304.995295:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790100304.995305:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.995310:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.995315:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.995321:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204160:0@lo:101: 00000100:00100000:2.0:1790100304.995338:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100304.995352:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100304.995366:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126204160 00000100:00100000:0.0:1790100304.995370:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126204160 00000100:00100000:0.0:1790100304.995395:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1790100304.995400:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790100304.995401:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126204160:12345-0@lo:101: 00010000:00010000:1.0:1790100304.995406:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100304.995407:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100304.995413:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781657600 already unused, calling callback (ffffffffc1d2ec20) 00010000:00010000:0.0:1790100304.995414:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcdd5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100304.995417:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.995443:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100304.995451:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100304.995456:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100304.995472:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.995479:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100304.995501:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdd5 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100304.995511:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdd5 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100304.995518:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530c00, rc 0) 00000100:00100000:3.0:1790100304.995532:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126204288:0@lo:103: 00000100:00100000:0.0:1790100304.995543:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126204160:12345-0@lo:101: Request processed in 143us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100304.995554:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790100304.995560:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100304.995637:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204160:0@lo:101: 00010000:00010000:2.0:1790100304.995648:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100304.995655:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100304.995703:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204416:0@lo:501: 00000100:00100000:2.0:1790100304.995726:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100304.995748:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100304.995753:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126204416 00000100:00100000:0.0:1790100304.995757:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126204416 00000100:00100000:0.0:1790100304.995791:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790100304.995798:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126204416:12345-0@lo:501: 00010000:00010000:1.0:1790100304.995808:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.995816:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781657600/0x31a8f3fdeeefcdc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x31a8f3fdeeefcdce expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100304.995828:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100304.995830:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100304.995832:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100304.995935:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126204416:12345-0@lo:501: Request processed in 137us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100304.995942:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790100304.995971:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204416:0@lo:501: 00000100:00100000:1.0:1790100304.995995:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204544:0@lo:503: 00000100:00100000:1.0:1790100304.996028:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.996044:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100304.996047:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126204544 00000100:00100000:0.0:1790100304.996051:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126204544 00000100:00100000:0.0:1790100304.996079:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790100304.996085:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126204544:12345-0@lo:503: 00000100:00100000:3.0:1790100304.996086:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126204288 00000100:00100000:3.0:1790100304.996089:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126204288 00000100:00100000:3.0:1790100304.996120:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100304.996126:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:3312:x1877056126204288:12345-0@lo:103: 00010000:00010000:3.0:1790100304.996134:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100304.996143:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf531000/0x31a8f3fdeeefcdce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdc7 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100304.996152:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100304.996182:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b150700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:3312:x1877056126204288:12345-0@lo:103: Request processed in 56us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100304.996189:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100304.996206:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126204544:12345-0@lo:503: Request processed in 120us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100304.996212:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790100304.996213:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126204288:0@lo:103: 00000100:00100000:1.0:1790100304.996260:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204544:0@lo:503: 00000040:00080000:1.0:1790100304.996523:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790100304.996562:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204672:0@lo:502: 00000100:00100000:1.0:1790100304.996589:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.996605:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100304.996634:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126204672 00000100:00100000:0.0:1790100304.996639:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126204672 00000100:00100000:0.0:1790100304.996729:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790100304.996738:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126204672:12345-0@lo:502: 00000100:00100000:0.0:1790100304.996864:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126204672:12345-0@lo:502: Request processed in 128us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100304.996871:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790100304.996881:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204672:0@lo:502: 00000040:00080000:1.0:1790100304.997045:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790100304.997074:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790100304.997102:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790100304.997150:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790100304.997182:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790100304.997214:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790100304.997233:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204800:0@lo:502: 00000100:00100000:1.0:1790100304.997263:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100304.997294:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b300 going to sleep for 11 seconds 00000100:00100000:2.0:1790100304.997334:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126204800 00000100:00100000:2.0:1790100304.997343:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126204800 00000100:00100000:2.0:1790100304.997370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790100304.997375:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126204800:12345-0@lo:502: 00000100:00100000:2.0:1790100304.997492:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126204800:12345-0@lo:502: Request processed in 116us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100304.997499:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790100304.997573:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204800:0@lo:502: 00000040:00080000:3.0:1790100304.997972:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790100304.998058:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1790100304.998372:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790100304.998379:0:7638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1790100304.998384:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100304.998386:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790100304.998390:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100304.998407:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d6787a2cd40) 00000020:00000080:0.0:1790100304.998445:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790100304.998452:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790100304.998517:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6787677800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790100304.998523:0:7638:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790100304.998529:0:7638:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x31a8f3fdeeefcdea 00010000:00010000:0.0:1790100305.000805:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1790100305.001070:0:7638:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1790100305.002421:0:7638:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1790100305.002782:0:7638:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1790100305.004819:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1790100305.005124:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790100305.006043:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790100305.006055:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100305.006061:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100305.006063:0:7638:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790100305.006067:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100305.006070:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100305.006072:0:7638:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790100305.006075:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790100305.006077:0:7638:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790100305.006125:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100305.006128:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100305.006129:0:7638:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790100305.006132:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790100305.006292:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1790100305.006317:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790100305.006343:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.006356:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100305.006365:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6787677800 from 1 10000000:01000000:1.0:1790100305.006368:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100305.006403:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.006410:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.006420:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100305.006462:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204928:0@lo:101: 00000100:00100000:1.0:1790100305.006530:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100305.006603:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100305.006797:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126204928 00000100:00100000:0.0:1790100305.006804:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126204928 00000100:00100000:0.0:1790100305.006885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790100305.006895:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+12:7632:x1877056126204928:12345-0@lo:101: 00010000:00010000:0.0:1790100305.006908:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100305.006920:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcdf1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100305.006954:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdf1 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100305.006964:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdf1 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100305.006973:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530e00, rc 0) 00000100:00100000:0.0:1790100305.007022:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126204928:12345-0@lo:101: Request processed in 128us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100305.007029:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790100305.007100:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126204928:0@lo:101: 00010000:00010000:2.0:1790100305.007114:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100305.007123:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100305.007206:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205056:0@lo:501: 00000100:00100000:2.0:1790100305.007226:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100305.007249:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100305.007264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126205056 00000100:00100000:1.0:1790100305.007268:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126205056 00000100:00100000:1.0:1790100305.007300:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790100305.007306:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126205056:12345-0@lo:501: 00000100:00100000:1.0:1790100305.007516:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126205056:12345-0@lo:501: Request processed in 210us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100305.007523:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790100305.007648:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205056:0@lo:501: 00000100:00100000:2.0:1790100305.007673:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205184:0@lo:503: 00000100:00100000:2.0:1790100305.007709:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100305.007729:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100305.008001:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126205184 00000100:00100000:1.0:1790100305.008007:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126205184 00000100:00100000:1.0:1790100305.008071:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790100305.008078:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126205184:12345-0@lo:503: 00000100:00100000:1.0:1790100305.008375:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126205184:12345-0@lo:503: Request processed in 296us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100305.008382:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790100305.008460:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205184:0@lo:503: 00000040:00080000:3.0:1790100305.008736:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100305.008788:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205312:0@lo:502: 00000100:00100000:3.0:1790100305.008814:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100305.008840:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100305.008855:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126205312 00000100:00100000:1.0:1790100305.008860:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126205312 00000100:00100000:1.0:1790100305.008890:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790100305.008896:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126205312:12345-0@lo:502: 00000100:00100000:1.0:1790100305.009033:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126205312:12345-0@lo:502: Request processed in 137us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100305.009040:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790100305.009056:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205312:0@lo:502: 00000040:00080000:3.0:1790100305.009284:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790100305.009329:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790100305.009350:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205440:0@lo:502: 00000100:00100000:3.0:1790100305.009379:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100305.009399:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100305.009469:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126205440 00000100:00100000:1.0:1790100305.009474:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126205440 00000100:00100000:1.0:1790100305.009516:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790100305.009522:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126205440:12345-0@lo:502: 00000100:00100000:1.0:1790100305.009649:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126205440:12345-0@lo:502: Request processed in 127us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100305.009655:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790100305.010286:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205440:0@lo:502: 00000040:00080000:3.0:1790100305.010543:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790100305.010555:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790100305.011101:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100305.011111:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100305.011114:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790100305.011121:0:7642:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6787677800 00000020:00000080:3.0:1790100305.011123:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100305.011150:0:7642:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100305.011153:0:7642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100305.011155:0:7642:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790100305.011158:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790100305.011503:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790100305.011536:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100305.011597:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.011630:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100305.011670:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790100305.011673:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d6787677800 10000000:01000000:1.0:1790100305.011676:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d6787677800 10000000:01000000:1.0:1790100305.011680:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100305.011685:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6787677800 from 1 10000000:01000000:1.0:1790100305.011687:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100305.011719:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.011728:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.011737:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100305.011756:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205568:0@lo:101: 00000100:00100000:1.0:1790100305.011810:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100305.011858:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790100305.012475:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126205568 00000100:00100000:2.0:1790100305.012483:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126205568 00000100:00100000:2.0:1790100305.012524:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790100305.012534:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126205568:12345-0@lo:101: 00010000:00010000:2.0:1790100305.012548:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100305.012560:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcdff expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100305.012596:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdff expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100305.012606:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdff expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100305.012641:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781656800, rc 0) 00000100:00100000:2.0:1790100305.012702:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126205568:12345-0@lo:101: Request processed in 169us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100305.012708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790100305.012735:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205568:0@lo:101: 00010000:00010000:1.0:1790100305.012749:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.012758:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100305.012850:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205696:0@lo:501: 00000100:00100000:1.0:1790100305.012876:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100305.012911:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790100305.012917:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126205696 00000100:00100000:2.0:1790100305.012921:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126205696 00000100:00100000:2.0:1790100305.012940:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790100305.012946:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126205696:12345-0@lo:501: 00000100:00100000:2.0:1790100305.013144:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126205696:12345-0@lo:501: Request processed in 198us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100305.013152:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790100305.013228:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205696:0@lo:501: 00000100:00100000:1.0:1790100305.013251:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205824:0@lo:503: 00000100:00100000:1.0:1790100305.013281:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100305.013308:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790100305.013461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126205824 00000100:00100000:2.0:1790100305.013466:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126205824 00000100:00100000:2.0:1790100305.013491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790100305.013497:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126205824:12345-0@lo:503: 00000100:00100000:2.0:1790100305.013700:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126205824:12345-0@lo:503: Request processed in 203us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100305.013708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790100305.013943:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205824:0@lo:503: 00000040:00080000:3.0:1790100305.014277:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100305.014332:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205952:0@lo:502: 00000100:00100000:3.0:1790100305.014370:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100305.014406:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100305.014463:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126205952 00000100:00100000:0.0:1790100305.014468:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126205952 00000100:00100000:0.0:1790100305.014502:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790100305.014513:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126205952:12345-0@lo:502: 00000100:00100000:0.0:1790100305.014726:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126205952:12345-0@lo:502: Request processed in 215us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100305.014734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790100305.014742:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126205952:0@lo:502: 00000040:00080000:1.0:1790100305.014966:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790100305.014997:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790100305.015015:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790100305.015038:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790100305.015056:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790100305.015088:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790100305.015108:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790100305.015125:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790100305.015149:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790100305.015166:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790100305.015182:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790100305.015217:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790100305.015247:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790100305.015264:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790100305.015289:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790100305.015306:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790100305.015323:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790100305.015366:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790100305.015387:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790100305.015404:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790100305.015427:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790100305.015471:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790100305.015502:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790100305.015561:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790100305.015598:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790100305.015665:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790100305.015714:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790100305.015749:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1790100305.015783:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790100305.015829:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1790100305.015862:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1790100305.015888:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1790100305.015914:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1790100305.015966:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1790100305.015994:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1790100305.016031:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1790100305.016058:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1790100305.016088:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126206080:0@lo:502: 00000100:00100000:1.0:1790100305.016143:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100305.016184:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100305.016583:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126206080 00000100:00100000:0.0:1790100305.016600:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126206080 00000100:00100000:0.0:1790100305.016659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790100305.016666:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126206080:12345-0@lo:502: 00000100:00100000:0.0:1790100305.016892:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126206080:12345-0@lo:502: Request processed in 225us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100305.016900:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790100305.016944:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126206080:0@lo:502: 00000040:00080000:3.0:1790100305.017021:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1790100305.017034:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1790100305.017557:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790100305.017574:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d67bf9b4d40) 00000020:00000080:2.0:1790100305.017677:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1790100305.017747:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6787677800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790100305.017769:0:7643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6787677800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790100305.017772:0:7643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6787677800 3 00010000:00080000:3.0:1790100305.017801:0:7643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d67b5cd2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.118@tcp at head 00010000:00010000:3.0:1790100305.019175:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1790100305.019415:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790100305.019520:0:7643:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790100305.019532:0:7643:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x31a8f3fdeeefce14 00000100:00080000:3.0:1790100305.019542:0:7643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790100305.019551:0:7643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d67b5cd2000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1790100305.019588:0:7643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d678b153800 x1877056126206208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100305.019740:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1877056126206208:0@lo:38: 00000100:00100000:0.0:1790100305.019812:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790100305.019897:0:7643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790100305.019973:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126206336:0@lo:400: 00000100:00100000:3.0:1790100305.019999:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100305.020022:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100305.020028:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126206464:0@lo:400: 00000100:00100000:3.0:1790100305.020056:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100305.020085:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126206592:0@lo:400: 00000100:00100000:3.0:1790100305.020111:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100305.020146:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126206208 00000100:00100000:3.0:1790100305.020152:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126206208 00000100:00100000:3.0:1790100305.020177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126206336 00000100:00100000:3.0:1790100305.020180:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126206336 00000100:00100000:3.0:1790100305.020199:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126206464 00000100:00100000:3.0:1790100305.020202:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126206464 00000100:00100000:3.0:1790100305.020227:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790100305.020234:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126206336:12345-0@lo:400: 00000100:00100000:3.0:1790100305.020279:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126206336:12345-0@lo:400: Request processed in 46us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100305.020286:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790100305.020314:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100305.020319:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126206464:12345-0@lo:400: 00000100:00100000:3.0:1790100305.020345:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126206464:12345-0@lo:400: Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100305.020350:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100305.020361:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100305.020365:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1877056126206208:12345-0@lo:38: 00010000:00080000:3.0:1790100305.020385:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1790100305.020415:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x31a8f3fdeeefce1b 00000004:00100000:3.0:1790100305.020447:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790100305.020479:0:5842:0:(import.c:65:import_set_state_nolock()) ffff8d67b59ef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100305.020798:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877056126206208:12345-0@lo:38: Request processed in 429us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100305.020815:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100305.020841:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126206592 00000100:00100000:3.0:1790100305.020846:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126206592 00000100:00100000:3.0:1790100305.020885:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100305.020892:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126206592:12345-0@lo:400: 00000100:00100000:3.0:1790100305.020933:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126206592:12345-0@lo:400: Request processed in 43us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100305.020939:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790100305.020958:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790100305.020962:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790100305.020987:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b153b80 x1877056126206592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100305.021000:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126206592:0@lo:400: 00010000:00080000:3.0:1790100305.021026:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b151500 x1877056126206464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100305.021034:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126206464:0@lo:400: 00010000:00080000:3.0:1790100305.021043:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b151880 x1877056126206336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100305.021049:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126206336:0@lo:400: 00010000:00080000:0.0:1790100305.021170:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d678b153800 x1877056126206208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100305.021178:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100305.021184:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1790100305.021192:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790100305.021196:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790100305.021198:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67b5cd2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790100305.021203:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1877056126206208:0@lo:38: 00000040:00080000:3.0:1790100305.021584:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1790100305.021824:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1790100305.021850:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790100305.021871:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.021895:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790100305.021940:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790100305.021943:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790100305.021945:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100305.021946:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100305.021947:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100305.021948:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100305.021950:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100305.021951:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790100305.021952:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790100305.021954:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100305.021955:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790100305.021959:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1790100305.021961:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790100305.021962:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790100305.021963:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100305.021964:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100305.021965:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100305.021966:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100305.021967:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100305.021968:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790100305.021970:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790100305.021971:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100305.021972:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790100305.022001:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790100305.022015:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126206720:0@lo:253: 00000100:00100000:1.0:1790100305.022063:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100305.022090:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100305.022157:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126206720 00000100:00100000:3.0:1790100305.022163:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126206720 00000100:00100000:3.0:1790100305.022202:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790100305.022210:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:7632:x1877056126206720:12345-0@lo:253: 20000000:01000000:3.0:1790100305.022234:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790100305.022254:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790100305.023587:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad885f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1877056126206848:0@lo:901: 00000100:00100000:0.0:1790100305.023655:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100305.023755:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788d5b000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100305.024273:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126206848 00000100:00100000:3.0:1790100305.024281:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126206848 00000100:00100000:3.0:1790100305.024342:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100305.024350:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1877056126206848:12345-0@lo:901: 00000100:00100000:3.0:1790100305.024723:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1877056126206848:12345-0@lo:901: Request processed in 372us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100305.024743:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790100305.024765:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790100305.024824:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67ad885f80 x1877056126206848/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790100321 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100305.024837:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad885f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1877056126206848:0@lo:901: 20000000:01000000:3.0:1790100305.043487:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790100305.044951:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790100305.045026:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790100305.045031:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790100305.045055:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.045084:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd5e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.045089:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.045122:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcd5e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.045132:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd5e expref: 14 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100305.045143:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1877056126206976:0@lo:104: 00000100:00100000:1.0:1790100305.045192:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100305.045235:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b540 going to sleep for 11 seconds 00000100:00100000:0.0:1790100305.045235:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126206976 00000100:00100000:0.0:1790100305.045243:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126206976 00000100:00100000:0.0:1790100305.045294:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100305.045313:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5857:x1877056126206976:12345-0@lo:104: 00010000:00010000:0.0:1790100305.045326:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100305.045373:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100305.045378:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:5857:x1877056126206976:12345-0@lo:104: Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100305.045384:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100305.045491:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1877056126206976:0@lo:104: 00010000:00010000:1.0:1790100305.045514:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100305.045642:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100305.045649:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100305.045656:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780030400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1790100305.045660:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100305.045668:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100305.045674:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100305.045679:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100305.045766:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100305.045774:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100305.045797:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100305.045805:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefcd5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100305.045819:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126207104:0@lo:103: 00000100:00100000:0.0:1790100305.045850:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100305.046050:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126207104 00000100:00100000:1.0:1790100305.046054:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126207104 00010000:00010000:1.0:1790100305.046074:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd5e expref: 15 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100305.046099:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100305.046104:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:3312:x1877056126207104:12345-0@lo:103: 00010000:00010000:1.0:1790100305.046111:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100305.046115:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd5e expref: 15 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046126:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd5e expref: 15 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046135:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefcd65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd5e expref: 15 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046144:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046149:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790100305.046158:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001874759s 00010000:00010000:1.0:1790100305.046161:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046166:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046170:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046173:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046176:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fe000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100305.046179:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046183:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046200:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100305.046210:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100305.046225:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100305.046241:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:3312:x1877056126207104:12345-0@lo:103: Request processed in 136us (390us total) trans 0 rc 0/0 00010000:00010000:0.0:1790100305.046243:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100305.046247:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790100305.046249:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67c21fe000/0x31a8f3fdeeefce22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100305.046310:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126207104:0@lo:103: 00010000:00010000:3.0:1790100305.046345:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100305.046347:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100305.046349:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100305.051035:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:7632:x1877056126206720:12345-0@lo:253: Request processed in 28817us (28962us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100305.051048:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790100305.051114:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44df9276-3139-4fbb-af61-ceba3e95d22a:7632:1877056126206720:0@lo:253: 10000000:01000000:1.0:1790100305.051126:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790100305.051130:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790100305.051132:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790100305.051133:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100305.051134:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100305.051135:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100305.051136:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100305.051137:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100305.051139:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790100305.051139:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790100305.051141:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100305.051141:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790100305.051157:0:7632:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790100305.056243:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100305.056560:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790100305.056920:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100305.057046:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790100305.057254:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100305.057780:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790100305.059208:0:7632:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1790100305.197485:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790100305.236281:0:7632:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790100305.236289:0:7632:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790100305.236319:0:7632:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790100305.236369:0:7632:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790100305.236383:0:7632:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790100305.236411:0:7632:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1790100306.213778:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100307.237720:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100308.207963:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126207232:0@lo:13: 00000100:00100000:0.0:1790100308.208026:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100308.208087:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126207232 00000100:00100000:0.0:1790100308.208094:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126207232 00000100:00100000:0.0:1790100308.208146:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100308.208154:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126207232:12345-0@lo:13: 00002000:00000024:0.0:1790100308.208195:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100308.208231:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad884380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126207232:12345-0@lo:13: Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100308.208238:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790100308.208271:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d678b151500 x1877056126207232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100308.208287:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126207232:0@lo:13: 00000100:00080000:3.0:1790100308.210723:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790100308.261771:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100309.291663:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790100309.635552:0:7986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790100310.245822:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126207488:0@lo:400: 00000100:00100000:1.0:1790100310.245822:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126207616:0@lo:400: 00000100:00100000:0.0:1790100310.245875:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126207360:0@lo:400: 00000100:00100000:2.0:1790100310.246701:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126207744:0@lo:400: 00000100:00100000:2.0:1790100310.250991:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100310.251102:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126207744 00000100:00100000:2.0:1790100310.251113:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126207744 00000100:00100000:2.0:1790100310.251181:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100310.251193:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126207744:12345-0@lo:400: 00000100:00100000:2.0:1790100310.251253:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126207744:12345-0@lo:400: Request processed in 64us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.251260:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790100310.251312:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d678b151f80 x1877056126207744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100310.251320:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100310.251326:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126207744:0@lo:400: 00000100:00080000:3.0:1790100310.251369:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100310.251383:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126207488 00000100:00100000:3.0:1790100310.251387:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126207488 00000100:00100000:3.0:1790100310.251485:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100310.251493:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126207488:12345-0@lo:400: 00000100:00100000:0.0:1790100310.251518:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.251528:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126207488:12345-0@lo:400: Request processed in 37us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100310.251533:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100310.251548:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126207872:0@lo:400: 00000100:00100000:0.0:1790100310.251585:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100310.254524:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126207872 00000100:00100000:2.0:1790100310.254539:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126207872 00000100:00100000:0.0:1790100310.254567:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126207360 00000100:00100000:0.0:1790100310.254571:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126207360 00000100:00100000:2.0:1790100310.254594:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100310.254602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790100310.254604:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126207872:12345-0@lo:400: 00000100:00100000:0.0:1790100310.254628:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:3314:x1877056126207360:12345-0@lo:400: 00000100:00080000:3.0:1790100310.254699:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790100310.254745:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d678b150380 x1877056126207488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100310.254760:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126207488:0@lo:400: 00000100:00100000:2.0:1790100310.254962:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126207872:12345-0@lo:400: Request processed in 359us (3375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.254969:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790100310.255073:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d678b153480 x1877056126207872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100310.255083:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126207872:0@lo:400: 00000100:00100000:0.0:1790100310.255409:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:3314:x1877056126207360:12345-0@lo:400: Request processed in 800us (3890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100310.255418:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790100310.255456:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100310.255595:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126207360:0@lo:400: 00000100:00100000:2.0:1790100310.256545:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126207616 00000100:00100000:2.0:1790100310.256554:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126207616 00000100:00100000:2.0:1790100310.256657:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790100310.256665:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126207616:12345-0@lo:400: 00000100:00100000:2.0:1790100310.256729:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126207616:12345-0@lo:400: Request processed in 64us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100310.256740:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1790100310.256848:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d678b150e00 x1877056126207616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100310.256860:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126207616:0@lo:400: 00000100:00080000:3.0:1790100310.256948:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790100310.310251:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100311.333924:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790100312.293707:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790100312.293713:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67ad888800 from 30 10000000:01000000:0.0:1790100312.293719:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790100312.293768:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100312.293780:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100312.293791:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100312.293812:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208000:0@lo:101: 00000100:00100000:0.0:1790100312.293890:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100312.293998:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fe70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100312.294112:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126208000 00000100:00100000:3.0:1790100312.294120:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126208000 00000100:00100000:3.0:1790100312.294378:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1790100312.294388:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126208000:12345-0@lo:101: 00010000:00010000:3.0:1790100312.294401:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100312.294413:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefce29 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.294434:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce29 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.294443:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce29 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.294452:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781522c00, rc 0) 00000100:00100000:3.0:1790100312.294497:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126208000:12345-0@lo:101: Request processed in 110us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100312.294503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790100312.294570:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208000:0@lo:101: 00010000:00010000:1.0:1790100312.294584:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.294604:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100312.294675:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208128:0@lo:501: 00000100:00100000:1.0:1790100312.294701:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.295212:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100312.295265:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126208128 00000100:00100000:0.0:1790100312.295270:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126208128 00000100:00100000:0.0:1790100312.295293:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790100312.295299:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126208128:12345-0@lo:501: 00000100:00100000:0.0:1790100312.295654:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126208128:12345-0@lo:501: Request processed in 353us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100312.295662:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790100312.298796:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208128:0@lo:501: 00000100:00100000:1.0:1790100312.298854:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208256:0@lo:503: 00000100:00100000:1.0:1790100312.299350:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.299397:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b780 going to sleep for 11 seconds 00000100:00100000:2.0:1790100312.299451:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126208256 00000100:00100000:2.0:1790100312.299458:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126208256 00000100:00100000:2.0:1790100312.299545:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790100312.299556:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126208256:12345-0@lo:503: 00000100:00100000:2.0:1790100312.300010:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126208256:12345-0@lo:503: Request processed in 455us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100312.300019:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790100312.300115:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208256:0@lo:503: 00000100:00100000:1.0:1790100312.300285:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8108:1877056126208384:0@lo:502: 00000100:00100000:1.0:1790100312.300335:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.302337:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100312.302394:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126208384 00000100:00100000:3.0:1790100312.302404:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126208384 00000100:00100000:3.0:1790100312.302447:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790100312.302456:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:8108:x1877056126208384:12345-0@lo:502: 00000100:00100000:3.0:1790100312.302799:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:8108:x1877056126208384:12345-0@lo:502: Request processed in 343us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100312.302806:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790100312.303254:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8108:1877056126208384:0@lo:502: 00000100:00100000:1.0:1790100312.303322:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8108:1877056126208512:0@lo:502: 00000100:00100000:1.0:1790100312.303361:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.303391:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100312.303432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126208512 00000100:00100000:3.0:1790100312.303438:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126208512 00000100:00100000:3.0:1790100312.303460:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790100312.303467:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:8108:x1877056126208512:12345-0@lo:502: 00000100:00100000:3.0:1790100312.303631:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:8108:x1877056126208512:12345-0@lo:502: Request processed in 141us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100312.303638:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790100312.303714:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8108:1877056126208512:0@lo:502: 00000040:00080000:1.0:1790100312.303732:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790100312.303864:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790100312.303884:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790100312.303894:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.303970:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100312.303981:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790100312.303984:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1790100312.303987:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790100312.304010:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.304018:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.304027:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100312.304048:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208640:0@lo:101: 00000100:00100000:3.0:1790100312.304075:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100312.304101:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a943a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.304139:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126208640 00000100:00100000:1.0:1790100312.304143:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126208640 00000100:00100000:1.0:1790100312.304161:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790100312.304167:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126208640:12345-0@lo:101: 00010000:00010000:1.0:1790100312.304181:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100312.304192:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefce37 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.304212:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce37 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.304221:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce37 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.304229:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21ff000, rc 0) 00000100:00100000:1.0:1790100312.304265:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126208640:12345-0@lo:101: Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.304270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790100312.304339:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208640:0@lo:101: 00010000:00010000:3.0:1790100312.304351:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.304359:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100312.304397:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208768:0@lo:501: 00000100:00100000:3.0:1790100312.304419:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100312.304439:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a943a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.304535:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126208768 00000100:00100000:1.0:1790100312.304540:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126208768 00000100:00100000:1.0:1790100312.304557:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790100312.304562:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126208768:12345-0@lo:501: 00000100:00100000:1.0:1790100312.304774:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126208768:12345-0@lo:501: Request processed in 210us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.304780:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790100312.304805:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208768:0@lo:501: 00000100:00100000:1.0:1790100312.304826:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208896:0@lo:503: 00000100:00100000:1.0:1790100312.304854:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.304871:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.304881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126208896 00000100:00100000:1.0:1790100312.304884:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126208896 00000100:00100000:1.0:1790100312.304898:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790100312.304922:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126208896:12345-0@lo:503: 00000100:00100000:1.0:1790100312.305172:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126208896:12345-0@lo:503: Request processed in 250us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.305179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790100312.305210:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126208896:0@lo:503: 00000100:00100000:1.0:1790100312.305371:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8109:1877056126209024:0@lo:502: 00000100:00100000:1.0:1790100312.305400:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.305418:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126209024 00000100:00100000:1.0:1790100312.305421:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126209024 00000100:00100000:1.0:1790100312.305435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790100312.305441:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:8109:x1877056126209024:12345-0@lo:502: 00000100:00100000:1.0:1790100312.305575:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:8109:x1877056126209024:12345-0@lo:502: Request processed in 134us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.305582:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790100312.305629:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.305641:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8109:1877056126209024:0@lo:502: 00000020:01000000:1.0:1790100312.305659:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100312.305667:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100312.305670:0:8109:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790100312.305675:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790100312.305677:0:8109:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790100312.305691:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8109:1877056126209152:0@lo:502: 00000100:00100000:1.0:1790100312.305722:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.305740:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126209152 00000100:00100000:1.0:1790100312.305744:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126209152 00000100:00100000:1.0:1790100312.305759:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790100312.305765:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:8109:x1877056126209152:12345-0@lo:502: 00000100:00100000:1.0:1790100312.305864:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:8109:x1877056126209152:12345-0@lo:502: Request processed in 99us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.305870:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790100312.305899:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.305909:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8109:1877056126209152:0@lo:502: 00000020:01000000:1.0:1790100312.305923:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100312.305926:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100312.305927:0:8109:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790100312.305931:0:8109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1790100312.305968:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1790100312.305995:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790100312.306002:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.306013:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100312.306022:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790100312.306024:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6788844800 from 30 10000000:01000000:1.0:1790100312.306027:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100312.306046:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.306054:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.306063:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100312.306074:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126209280:0@lo:101: 00000100:00100000:1.0:1790100312.306105:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.306117:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.306128:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126209280 00000100:00100000:1.0:1790100312.306131:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126209280 00000100:00100000:1.0:1790100312.306147:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790100312.306152:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126209280:12345-0@lo:101: 00010000:00010000:1.0:1790100312.306160:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100312.306171:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefce45 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.306191:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce45 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.306201:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce45 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.306208:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21ff400, rc 0) 00000100:00100000:1.0:1790100312.306232:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126209280:12345-0@lo:101: Request processed in 80us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.306239:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790100312.306262:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126209280:0@lo:101: 00010000:00010000:1.0:1790100312.306273:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.306281:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100312.306329:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126209408:0@lo:501: 00000100:00100000:1.0:1790100312.306361:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.306372:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.306383:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126209408 00000100:00100000:1.0:1790100312.306386:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126209408 00000100:00100000:1.0:1790100312.306401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790100312.306406:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126209408:12345-0@lo:501: 00000100:00100000:1.0:1790100312.306581:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126209408:12345-0@lo:501: Request processed in 174us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.306589:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790100312.306641:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126209408:0@lo:501: 00000100:00100000:1.0:1790100312.306661:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126209536:0@lo:503: 00000100:00100000:1.0:1790100312.306691:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.306708:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.306718:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126209536 00000100:00100000:1.0:1790100312.306721:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126209536 00000100:00100000:1.0:1790100312.306736:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790100312.306741:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126209536:12345-0@lo:503: 00000100:00100000:1.0:1790100312.306852:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126209536:12345-0@lo:503: Request processed in 110us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.306859:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790100312.306890:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126209536:0@lo:503: 00000100:00100000:1.0:1790100312.307080:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8110:1877056126209664:0@lo:502: 00000100:00100000:1.0:1790100312.307111:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.307127:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126209664 00000100:00100000:1.0:1790100312.307131:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126209664 00000100:00100000:1.0:1790100312.307147:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790100312.307159:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:8110:x1877056126209664:12345-0@lo:502: 00000100:00100000:1.0:1790100312.307299:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:8110:x1877056126209664:12345-0@lo:502: Request processed in 140us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.307306:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790100312.307343:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272be40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.307354:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8110:1877056126209664:0@lo:502: 00000100:00100000:1.0:1790100312.307387:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8110:1877056126209792:0@lo:502: 00000100:00100000:1.0:1790100312.307414:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.307431:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126209792 00000100:00100000:1.0:1790100312.307434:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126209792 00000100:00100000:1.0:1790100312.307449:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790100312.307454:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:8110:x1877056126209792:12345-0@lo:502: 00000100:00100000:1.0:1790100312.307565:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:8110:x1877056126209792:12345-0@lo:502: Request processed in 109us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.307572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790100312.307596:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272be40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.307632:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8110:1877056126209792:0@lo:502: 00000040:00080000:1.0:1790100312.307650:0:8110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790100312.307688:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790100312.307710:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790100312.307719:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.307730:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100312.307738:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790100312.307746:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6788844800 from 5 10000000:01000000:1.0:1790100312.307750:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790100312.307769:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.307777:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.307786:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100312.307797:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126209920:0@lo:101: 00000100:00100000:1.0:1790100312.307820:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.307839:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272be40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.307849:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126209920 00000100:00100000:1.0:1790100312.307852:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126209920 00000100:00100000:1.0:1790100312.307867:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790100312.307872:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126209920:12345-0@lo:101: 00010000:00010000:1.0:1790100312.307881:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100312.307892:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefce5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefce53 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.307909:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefce5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce53 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.307919:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefce5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce53 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.307927:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780030e00, rc 0) 00000100:00100000:1.0:1790100312.307951:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126209920:12345-0@lo:101: Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.307963:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790100312.307989:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126209920:0@lo:101: 00010000:00010000:1.0:1790100312.307999:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.308007:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100312.308042:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210048:0@lo:256: 00000100:00100000:1.0:1790100312.308068:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.308079:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272be40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.308089:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126210048 00000100:00100000:1.0:1790100312.308092:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126210048 00000100:00100000:1.0:1790100312.308107:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790100312.308112:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126210048:12345-0@lo:256: 20000000:01000000:1.0:1790100312.308124:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790100312.308139:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790100312.308142:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1790100312.308208:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126210048:12345-0@lo:256: Request processed in 96us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.308215:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790100312.308239:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210048:0@lo:256: 10000000:01000000:1.0:1790100312.308281:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790100312.308286:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.308294:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100312.308306:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790100312.310729:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1790100312.310734:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790100312.310771:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.310781:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.310792:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100312.310811:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210176:0@lo:101: 00000100:00100000:1.0:1790100312.310872:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.312035:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad4f3180 going to sleep for 11 seconds 00000100:00100000:2.0:1790100312.312185:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126210176 00000100:00100000:2.0:1790100312.312193:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126210176 00000100:00100000:2.0:1790100312.312276:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790100312.312286:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126210176:12345-0@lo:101: 00010000:00010000:2.0:1790100312.312298:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100312.312322:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefce61 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100312.312346:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce61 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100312.312356:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce61 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100312.312365:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781657800, rc 0) 00000100:00100000:2.0:1790100312.312419:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126210176:12345-0@lo:101: Request processed in 135us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100312.312426:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790100312.312493:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210176:0@lo:101: 00010000:00010000:1.0:1790100312.312508:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.312517:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100312.312571:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210304:0@lo:501: 00000100:00100000:1.0:1790100312.312599:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.315247:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad4f3180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100312.315461:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126210304 00000100:00100000:0.0:1790100312.315469:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126210304 00000100:00100000:0.0:1790100312.315556:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790100312.315565:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126210304:12345-0@lo:501: 00000100:00100000:0.0:1790100312.315846:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126210304:12345-0@lo:501: Request processed in 281us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100312.315853:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790100312.316109:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210304:0@lo:501: 00000100:00100000:1.0:1790100312.316153:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210432:0@lo:503: 00000100:00100000:1.0:1790100312.316199:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.316218:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad4f3180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.316657:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126210432 00000100:00100000:1.0:1790100312.316668:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126210432 00000100:00100000:1.0:1790100312.316692:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790100312.316698:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126210432:12345-0@lo:503: 00000100:00100000:1.0:1790100312.317052:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126210432:12345-0@lo:503: Request processed in 352us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.317059:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790100312.317088:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210432:0@lo:503: 00000100:00100000:1.0:1790100312.317322:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8112:1877056126210560:0@lo:502: 00000100:00100000:1.0:1790100312.317354:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.317377:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad4f3240 going to sleep for 11 seconds 00000100:00100000:3.0:1790100312.317434:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126210560 00000100:00100000:3.0:1790100312.317439:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126210560 00000100:00100000:3.0:1790100312.317466:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790100312.317473:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8112:x1877056126210560:12345-0@lo:502: 00000100:00100000:3.0:1790100312.317920:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8112:x1877056126210560:12345-0@lo:502: Request processed in 446us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100312.317926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790100312.318031:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8112:1877056126210560:0@lo:502: 00000020:01000000:1.0:1790100312.318059:0:8112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790100312.318066:0:8112:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790100312.318073:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100312.318075:0:8112:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790100312.318079:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790100312.318082:0:8112:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:1.0:1790100312.318101:0:8112:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790100312.318104:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790100312.318116:0:8112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d6784ed99c0) 00000020:00000080:1.0:1790100312.318135:0:8112:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1790100312.318138:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790100312.318211:0:8112:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790100312.318217:0:8112:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790100312.318226:0:8112:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefce76 00010000:00080000:1.0:1790100312.318251:0:8112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d67bbb84800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1790100312.318464:0:8112:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1790100312.318818:0:8112:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1790100312.318829:0:8112:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790100312.319338:0:8112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100312.319525:0:8112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100312.319570:0:8112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1790100312.319707:0:8112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790100312.320133:0:8113:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100312.320138:0:8113:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790100312.320745:0:8112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790100312.320756:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790100312.320784:0:8112:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790100312.320803:0:8112:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefce7d 00000100:00080000:1.0:1790100312.320813:0:8112:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790100312.320823:0:8112:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d67bbb84800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1790100312.320855:0:8112:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67ad87f480 x1877056126210688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100312.320880:0:8112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790100312.320983:0:8112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100312.320987:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100312.320988:0:8112:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790100312.320991:0:8112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100312.320995:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100312.320996:0:8112:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790100312.320999:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790100312.321000:0:8112:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790100312.321021:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8112:1877056126210816:0@lo:502: 00000100:00100000:1.0:1790100312.321088:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.321119:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100312.321162:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126210688:0@lo:8: 00000100:00100000:3.0:1790100312.321201:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.321262:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126210688 00000100:00100000:1.0:1790100312.321273:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126210688 00000100:00100000:1.0:1790100312.321304:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100312.321319:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1877056126210688:12345-0@lo:8: 00010000:00080000:1.0:1790100312.321340:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1790100312.321362:0:6689:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefce84 00002000:00100000:1.0:1790100312.321374:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d67bbb82000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790100312.321378:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1790100312.321382:0:6689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1790100312.321461:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790100312.321579:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790100312.321600:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8d67bbb84000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100312.321676:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1877056126210688:12345-0@lo:8: Request processed in 356us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.321683:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790100312.321718:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87f480 x1877056126210688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100312.321728:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790100312.321734:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790100312.321740:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790100312.321745:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790100312.321747:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67bbb84800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790100312.321754:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790100312.321758:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126210688:0@lo:8: 00000004:00080000:3.0:1790100312.321816:0:8113:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790100312.321965:0:8113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 208891353548ns, next at 0ns, rc = 0 00000100:00100000:2.0:1790100312.322115:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126210816 00000100:00100000:2.0:1790100312.322119:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126210816 00000100:00100000:2.0:1790100312.322177:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790100312.322184:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8112:x1877056126210816:12345-0@lo:502: 00000100:00100000:2.0:1790100312.322397:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8112:x1877056126210816:12345-0@lo:502: Request processed in 213us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100312.322404:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790100312.322471:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8112:1877056126210816:0@lo:502: 00000020:01000000:3.0:1790100312.322494:0:8112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100312.322499:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100312.322501:0:8112:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790100312.322506:0:8112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1790100312.322551:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1790100312.322572:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790100312.322581:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.322591:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100312.322601:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790100312.322604:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d6784edb380 from 1 10000000:01000000:3.0:1790100312.322607:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790100312.322782:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.322791:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100312.322800:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100312.322813:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b150380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210944:0@lo:101: 00000100:00100000:3.0:1790100312.322843:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100312.323043:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a943a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.323095:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126210944 00000100:00100000:1.0:1790100312.323100:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126210944 00000100:00100000:1.0:1790100312.323124:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790100312.323131:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126210944:12345-0@lo:101: 00010000:00010000:1.0:1790100312.323146:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100312.323158:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefce8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.323180:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce8b expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.323190:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce8b expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.323198:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780030200, rc 0) 00000100:00100000:1.0:1790100312.323231:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126210944:12345-0@lo:101: Request processed in 101us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.323237:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790100312.323270:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b150380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126210944:0@lo:101: 00010000:00010000:1.0:1790100312.323281:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.323289:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100312.323349:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126211072:0@lo:501: 00000100:00100000:1.0:1790100312.323373:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.323386:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.323397:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126211072 00000100:00100000:1.0:1790100312.323400:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126211072 00000100:00100000:1.0:1790100312.323415:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790100312.323420:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126211072:12345-0@lo:501: 00000100:00100000:1.0:1790100312.323640:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126211072:12345-0@lo:501: Request processed in 218us (265us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790100312.323647:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790100312.323674:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126211072:0@lo:501: 10000000:01000000:1.0:1790100312.323693:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790100312.323699:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100312.323708:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100312.324796:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126211456:0@lo:400: 00000100:00100000:1.0:1790100312.324832:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.324858:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100312.324863:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126211584:0@lo:400: 00000100:00100000:1.0:1790100312.324890:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100312.325799:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126211328:0@lo:400: 00000100:00100000:2.0:1790100312.325842:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100312.325868:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100312.325875:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126211200:0@lo:400: 00000100:00100000:2.0:1790100312.325897:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100312.325998:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126211584 00000100:00100000:2.0:1790100312.326006:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126211584 00000100:00100000:2.0:1790100312.326054:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126211328 00000100:00100000:2.0:1790100312.326057:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126211328 00000100:00100000:2.0:1790100312.326072:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126211200 00000100:00100000:2.0:1790100312.326075:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126211200 00000100:00100000:2.0:1790100312.326088:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100312.326095:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126211584:12345-0@lo:400: 00000100:00100000:2.0:1790100312.326144:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126211584:12345-0@lo:400: Request processed in 48us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100312.326151:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100312.326167:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100312.326174:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126211328:12345-0@lo:400: 00000100:00100000:2.0:1790100312.326205:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126211328:12345-0@lo:400: Request processed in 31us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100312.326211:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100312.326221:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100312.326226:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126211200:12345-0@lo:400: 00000100:00100000:2.0:1790100312.326251:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126211200:12345-0@lo:400: Request processed in 25us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100312.326271:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1790100312.326290:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790100312.326328:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87f480 x1877056126211200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100312.326341:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126211200:0@lo:400: 00010000:00080000:2.0:1790100312.326353:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87e680 x1877056126211328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100312.326361:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126211328:0@lo:400: 00010000:00080000:1.0:1790100312.326447:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87d880 x1877056126211584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100312.326457:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126211584:0@lo:400: 00000100:00100000:1.0:1790100312.326478:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126211456 00000100:00100000:1.0:1790100312.326482:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126211456 00000100:00100000:1.0:1790100312.326523:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100312.326531:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126211456:12345-0@lo:400: 00000100:00100000:1.0:1790100312.326569:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126211456:12345-0@lo:400: Request processed in 40us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100312.326576:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790100312.326632:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87ea00 x1877056126211456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100312.326642:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126211456:0@lo:400: 00000100:00080000:2.0:1790100312.326998:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1790100312.357533:0:8114:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790100312.357574:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8114:1877056126211840:0@lo:7: 00000100:00100000:1.0:1790100312.357678:0:8114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.357706:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100312.357728:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100312.357739:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126211712:0@lo:13: 00000100:00100000:1.0:1790100312.357766:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100312.357918:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126211840 00000100:00100000:3.0:1790100312.357926:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126211840 00000100:00100000:3.0:1790100312.357994:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100312.358004:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8114:x1877056126211840:12345-0@lo:7: 00000004:00080000:2.0:1790100312.361585:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:2.0:1790100312.362070:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100312.362114:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126211712 00000100:00100000:0.0:1790100312.362124:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126211712 00000100:00100000:0.0:1790100312.362179:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100312.362190:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1877056126211712:12345-0@lo:13: 00002000:00000024:0.0:1790100312.362220:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1790100312.362381:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1877056126211712:12345-0@lo:13: Request processed in 194us (4614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100312.362389:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790100312.362457:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1790100312.363733:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87ea00 x1877056126211712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100312.363758:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126211712:0@lo:13: 00002000:00080000:3.0:1790100312.364861:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1790100312.364867:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790100312.365048:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8114:x1877056126211840:12345-0@lo:7: Request processed in 7044us (7367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100312.365058:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790100312.365126:0:8114:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87d880 x1877056126211840/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790100328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100312.365138:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8114:1877056126211840:0@lo:7: 00000004:00080000:1.0:1790100312.365149:0:8114:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790100312.365183:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8114:1877056126211968:0@lo:5: 00000100:00100000:1.0:1790100312.365213:0:8114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100312.365298:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100312.365338:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126211968 00000100:00100000:2.0:1790100312.365345:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126211968 00000100:00100000:2.0:1790100312.365413:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790100312.365422:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8114:x1877056126211968:12345-0@lo:5: 00002000:00080000:2.0:1790100312.365445:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790100312.365449:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790100312.365712:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8114:x1877056126211968:12345-0@lo:5: Request processed in 291us (498us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790100312.365720:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790100312.365783:0:8114:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87d880 x1877056126211968/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100312.365796:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8114:1877056126211968:0@lo:5: 00000004:00080000:0.0:1790100312.365805:0:8114:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790100312.365828:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8114:1877056126212096:0@lo:700: 00000100:00100000:0.0:1790100312.365853:0:8114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100312.365870:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fe79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100312.365883:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126212096 00000100:00100000:0.0:1790100312.365887:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126212096 00000100:00100000:0.0:1790100312.366087:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100312.366095:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8114:x1877056126212096:12345-0@lo:700: 00000100:00100000:0.0:1790100312.366121:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e40000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1877056126212224:0@lo:700: 00000100:00100000:0.0:1790100312.366148:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100312.366172:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fe7480 going to sleep for 11 seconds 00000100:00100000:3.0:1790100312.366228:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126212224 00000100:00100000:3.0:1790100312.366233:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126212224 00000100:00100000:3.0:1790100312.366268:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100312.366275:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1877056126212224:12345-0@lo:700: 40000000:02000000:3.0:1790100312.388753:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1790100312.400032:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1877056126212224:12345-0@lo:700: Request processed in 33749us (33876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100312.400047:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790100312.404220:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6784e40000 x1877056126212224/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790100328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100312.404240:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e40000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1877056126212224:0@lo:700: 40000000:02000000:0.0:1790100312.404264:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:0.0:1790100312.467782:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790100312.467802:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1790100312.469366:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8114:x1877056126212096:12345-0@lo:700: Request processed in 103265us (103504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100312.469386:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790100312.469693:0:8114:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6784e40e00 x1877056126212096/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790100328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100312.469706:0:8114:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790100312.469723:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8114:1877056126212096:0@lo:700: 00000004:02000040:2.0:1790100312.519119:0:8114:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1790100312.528360:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8114:1877056126212352:0@lo:5: 00000100:00100000:3.0:1790100312.528431:0:8114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100312.528489:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad4583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100312.528654:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126212352 00000100:00100000:2.0:1790100312.528663:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126212352 00000100:00100000:2.0:1790100312.528718:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100312.528728:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8114:x1877056126212352:12345-0@lo:5: 00002000:00080000:3.0:1790100312.543698:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790100312.543723:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1790100312.562521:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8114:x1877056126212352:12345-0@lo:5: Request processed in 33786us (34081us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790100312.562535:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790100312.562821:0:8114:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d678b151180 x1877056126212352/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790100328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100312.562842:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8114:1877056126212352:0@lo:5: 00000004:00080000:2.0:1790100312.562856:0:8114:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1790100313.318235:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126212480:0@lo:13: 00000100:00100000:0.0:1790100313.318337:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100313.318388:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126212480 00000100:00100000:2.0:1790100313.318399:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126212480 00000100:00100000:2.0:1790100313.319033:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790100313.319046:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126212480:12345-0@lo:13: 00002000:00000024:2.0:1790100313.319386:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100313.319463:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126212480:12345-0@lo:13: Request processed in 419us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100313.319471:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790100313.319812:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87f480 x1877056126212480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100313.319834:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126212480:0@lo:13: 00010000:00010000:0.0:1790100313.383909:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790100313.874395:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1790100314.294314:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100314.294442:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109412480 00000100:00100000:3.0:1790100314.294466:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109412480 00000100:00100000:3.0:1790100314.294516:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 110 00000100:00100000:3.0:1790100314.294526:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2356:x1877056109412480:12345-192.168.201.18@tcp:250: 00010000:00080000:3.0:1790100314.294556:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ecdcb1a1-7d2e-433e-8696-b6cc55d35b85@192.168.201.18@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1790100314.294584:0:5836:0:(genops.c:1384:class_connect()) connect: client ecdcb1a1-7d2e-433e-8696-b6cc55d35b85, cookie 0x31a8f3fdeeefce99 00000100:00080000:3.0:1790100314.294763:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8d6787676000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100314.294830:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+5:2356:x1877056109412480:12345-192.168.201.18@tcp:250: Request processed in 305us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100314.294839:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 110 00000100:00100000:1.0:1790100314.296440:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100314.296601:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109412608 00000100:00100000:3.0:1790100314.296627:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109412608 00000100:00100000:3.0:1790100314.296678:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:3.0:1790100314.296688:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+5:5581:x1877056109412608:12345-192.168.201.18@tcp:101: 00010000:00010000:3.0:1790100314.296704:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100314.296720:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ad5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100314.296748:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ad5 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100314.296761:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ad5 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100314.296769:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781523400, rc 0) 00000100:00100000:3.0:1790100314.296816:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+6:5581:x1877056109412608:12345-192.168.201.18@tcp:101: Request processed in 129us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100314.296822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:3.0:1790100314.297978:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100314.298049:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109412736 00000100:00100000:1.0:1790100314.298056:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109412736 00000100:00100000:1.0:1790100314.298097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:1.0:1790100314.298105:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+6:5581:x1877056109412736:12345-192.168.201.18@tcp:501: 00000100:00100000:1.0:1790100314.298432:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+6:5581:x1877056109412736:12345-192.168.201.18@tcp:501: Request processed in 326us (458us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790100314.298439:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:3.0:1790100314.306844:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100314.307091:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109412864 00000100:00100000:0.0:1790100314.307102:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109412864 00000100:00100000:0.0:1790100314.307156:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:0.0:1790100314.307167:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+6:5581:x1877056109412864:12345-192.168.201.18@tcp:101: 00010000:00010000:0.0:1790100314.307186:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100314.307204:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64adc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100314.307232:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64adc expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100314.307244:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64adc expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100314.307253:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530600, rc 0) 00000100:00100000:0.0:1790100314.307326:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+7:5581:x1877056109412864:12345-192.168.201.18@tcp:101: Request processed in 161us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100314.307349:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:0.0:1790100314.313888:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100314.314651:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109412992 00000100:00100000:3.0:1790100314.314663:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109412992 00000100:00100000:3.0:1790100314.314716:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:3.0:1790100314.314727:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+7:5581:x1877056109412992:12345-192.168.201.18@tcp:501: 00000100:00100000:3.0:1790100314.314966:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:5581:x1877056109412992:12345-192.168.201.18@tcp:501: Request processed in 241us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100314.314973:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:0.0:1790100314.318660:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100314.318761:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109413120 00000100:00100000:1.0:1790100314.318772:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109413120 00000100:00100000:1.0:1790100314.318816:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:1.0:1790100314.318824:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:5581:x1877056109413120:12345-192.168.201.18@tcp:503: 00000100:00100000:1.0:1790100314.319167:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:5581:x1877056109413120:12345-192.168.201.18@tcp:503: Request processed in 342us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100314.319175:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:0.0:1790100314.325689:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100314.325794:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109413248 00000100:00100000:2.0:1790100314.325805:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109413248 00000100:00100000:2.0:1790100314.325859:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:2.0:1790100314.325870:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:5600:x1877056109413248:12345-192.168.201.18@tcp:502: 00000100:00100000:2.0:1790100314.326211:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:5600:x1877056109413248:12345-192.168.201.18@tcp:502: Request processed in 341us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100314.326219:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:0.0:1790100314.359413:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100314.359504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109413376 00000100:00100000:3.0:1790100314.359527:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109413376 00000100:00100000:3.0:1790100314.359641:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:3.0:1790100314.359652:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:5600:x1877056109413376:12345-192.168.201.18@tcp:502: 00000100:00100000:3.0:1790100314.359948:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:5600:x1877056109413376:12345-192.168.201.18@tcp:502: Request processed in 298us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100314.359958:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:0.0:1790100314.369550:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100314.369748:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109413504 00000100:00100000:3.0:1790100314.369760:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109413504 00000100:00100000:3.0:1790100314.369824:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:3.0:1790100314.369835:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:5581:x1877056109413504:12345-192.168.201.18@tcp:101: 00010000:00010000:3.0:1790100314.369853:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100314.369871:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781523e00/0x31a8f3fdeeefceae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64b06 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100314.369899:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781523e00/0x31a8f3fdeeefceae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b06 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100314.369911:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781523e00/0x31a8f3fdeeefceae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b06 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100314.369931:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781523e00, rc 0) 00000100:00100000:3.0:1790100314.369984:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5581:x1877056109413504:12345-192.168.201.18@tcp:101: Request processed in 151us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100314.369992:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:3.0:1790100314.375381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100314.375585:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109413632 00000100:00100000:3.0:1790100314.375596:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109413632 00000100:00100000:3.0:1790100314.375666:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:3.0:1790100314.375677:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5581:x1877056109413632:12345-192.168.201.18@tcp:256: 20000000:01000000:3.0:1790100314.375705:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790100314.375726:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790100314.375730:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790100314.375733:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790100314.375736:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790100314.379239:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5581:x1877056109413632:12345-192.168.201.18@tcp:256: Request processed in 3551us (3857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100314.379255:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:2.0:1790100314.386605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100314.386755:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109413760 00000100:00100000:3.0:1790100314.386768:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109413760 00000100:00100000:3.0:1790100314.386829:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:3.0:1790100314.386840:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5581:x1877056109413760:12345-192.168.201.18@tcp:101: 00010000:00010000:3.0:1790100314.386858:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100314.386875:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64b0d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100314.386902:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b0d expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100314.386930:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b0d expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100314.386938:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781523600, rc 0) 00000100:00100000:3.0:1790100314.386994:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5581:x1877056109413760:12345-192.168.201.18@tcp:101: Request processed in 156us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100314.387002:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:3.0:1790100314.391508:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100314.391652:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109413888 00000100:00100000:1.0:1790100314.391662:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109413888 00000100:00100000:1.0:1790100314.391721:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:1.0:1790100314.391731:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5581:x1877056109413888:12345-192.168.201.18@tcp:501: 00000100:00100000:1.0:1790100314.392039:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5581:x1877056109413888:12345-192.168.201.18@tcp:501: Request processed in 309us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100314.392049:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:3.0:1790100314.393819:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100314.393897:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109414016 00000100:00100000:2.0:1790100314.393907:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109414016 00000100:00100000:2.0:1790100314.393958:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:2.0:1790100314.393968:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5581:x1877056109414016:12345-192.168.201.18@tcp:503: 00000100:00100000:2.0:1790100314.394325:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5581:x1877056109414016:12345-192.168.201.18@tcp:503: Request processed in 357us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100314.394334:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:3.0:1790100314.396898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100314.397042:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109414144 00000100:00100000:0.0:1790100314.397054:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109414144 00000100:00100000:0.0:1790100314.397109:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:0.0:1790100314.397119:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5605:x1877056109414144:12345-192.168.201.18@tcp:502: 00000100:00100000:0.0:1790100314.397402:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5605:x1877056109414144:12345-192.168.201.18@tcp:502: Request processed in 283us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100314.397411:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:3.0:1790100314.405292:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100314.405331:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109414272 00000100:00100000:3.0:1790100314.405341:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109414272 00000100:00100000:3.0:1790100314.405391:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:3.0:1790100314.405403:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5605:x1877056109414272:12345-192.168.201.18@tcp:502: 00000100:00100000:3.0:1790100314.405661:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5605:x1877056109414272:12345-192.168.201.18@tcp:502: Request processed in 260us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100314.405669:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 124 00010000:00010000:3.0:1790100314.409037:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100314.410897:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100314.411017:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109414400 00000100:00100000:3.0:1790100314.411027:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109414400 00000100:00100000:3.0:1790100314.411076:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1790100314.411085:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1877056109414400:12345-192.168.201.18@tcp:38: 00010000:00080000:3.0:1790100314.411112:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1790100314.411159:0:5842:0:(genops.c:1384:class_connect()) connect: client dd2cd87b-6ca1-4323-9b74-fad785d94e6c, cookie 0x31a8f3fdeeefcebc 00000004:00100000:3.0:1790100314.411199:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1790100314.411205:0:5842:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1790100314.435557:0:5842:0:(import.c:65:import_set_state_nolock()) ffff8d67b5cd0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100314.435674:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2356:x1877056109414400:12345-192.168.201.18@tcp:38: Request processed in 24588us (24785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100314.435685:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00010000:00010000:0.0:1790100315.433601:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100315.443829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100315.443924:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109414656 00000100:00100000:2.0:1790100315.443935:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109414656 00000100:00100000:2.0:1790100315.444025:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:2.0:1790100315.444036:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:5581:x1877056109414656:12345-192.168.201.18@tcp:41: 00000004:00000024:2.0:1790100315.444080:0:6711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790100315.444148:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:5581:x1877056109414656:12345-192.168.201.18@tcp:41: Request processed in 113us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100315.444155:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00080000:0.0:1790100315.444337:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100315.444521:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100315.444730:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109414528 00000100:00100000:0.0:1790100315.444736:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109414528 00000100:00100000:0.0:1790100315.444766:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1790100315.444772:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:0:x1877056109414528:12345-192.168.201.18@tcp:41: 00000004:00000024:0.0:1790100315.444787:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790100315.444832:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:0:x1877056109414528:12345-192.168.201.18@tcp:41: Request processed in 59us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100315.444838:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1790100315.448421:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100315.448517:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109414784 00000100:00100000:2.0:1790100315.448529:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109414784 00000100:00100000:2.0:1790100315.448598:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1790100315.448632:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:5581:x1877056109414784:12345-192.168.201.18@tcp:40: 00000100:00100000:2.0:1790100315.448723:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:5581:x1877056109414784:12345-192.168.201.18@tcp:40: Request processed in 115us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100315.448729:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:1.0:1790100315.451747:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100315.451876:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109414912 00000100:00100000:2.0:1790100315.451887:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109414912 00000100:00100000:2.0:1790100315.451970:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1790100315.451979:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1877056109414912:12345-192.168.201.18@tcp:8: 00010000:00080000:2.0:1790100315.452026:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1790100315.452057:0:6689:0:(genops.c:1384:class_connect()) connect: client dd2cd87b-6ca1-4323-9b74-fad785d94e6c, cookie 0x31a8f3fdeeefcec3 00002000:00100000:2.0:1790100315.452069:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd2cd87b-6ca1-4323-9b74-fad785d94e6c/ffff8d67bf9a8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790100315.452093:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790100315.452430:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790100315.452458:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8d67bf9a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100315.452799:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2356:x1877056109414912:12345-192.168.201.18@tcp:8: Request processed in 818us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100315.452815:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1790100315.453916:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100315.454778:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109415168 00000100:00100000:3.0:1790100315.454790:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109415168 00000100:00100000:3.0:1790100315.454845:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:3.0:1790100315.454856:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2359:x1877056109415168:12345-192.168.201.18@tcp:400: 00000100:00100000:3.0:1790100315.454920:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2359:x1877056109415168:12345-192.168.201.18@tcp:400: Request processed in 66us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100315.454927:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:3.0:1790100315.454976:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100315.455169:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109415296 00000100:00100000:0.0:1790100315.455174:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109415296 00000100:00100000:0.0:1790100315.455227:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1790100315.455235:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:5581:x1877056109415296:12345-192.168.201.18@tcp:33: 00000100:00100000:0.0:1790100315.456819:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100315.457359:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109415040 00000100:00100000:2.0:1790100315.457370:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109415040 00000100:00100000:2.0:1790100315.457424:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1790100315.457433:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1877056109415040:12345-192.168.201.18@tcp:8: 00010000:00080000:2.0:1790100315.457468:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1790100315.457500:0:6690:0:(genops.c:1384:class_connect()) connect: client dd2cd87b-6ca1-4323-9b74-fad785d94e6c, cookie 0x31a8f3fdeeefceca 00002000:00100000:2.0:1790100315.457777:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd2cd87b-6ca1-4323-9b74-fad785d94e6c/ffff8d67bf9ae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790100315.457806:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790100315.460218:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790100315.460271:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8d67bf9ad800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100315.460362:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2356:x1877056109415040:12345-192.168.201.18@tcp:8: Request processed in 2927us (3552us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100315.460374:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000004:00080000:2.0:1790100315.476720:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 21408us 00000004:00200000:2.0:1790100315.507773:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790100315.507915:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:5581:x1877056109415296:12345-192.168.201.18@tcp:33: Request processed in 52674us (52931us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100315.507933:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:3.0:1790100315.679935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100315.680024:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109415424 00000100:00100000:0.0:1790100315.680032:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109415424 00000100:00100000:0.0:1790100315.680080:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1790100315.680087:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:5623:x1877056109415424:12345-192.168.201.18@tcp:101: 00010000:00010000:0.0:1790100315.680104:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100315.680122:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531c00/0x31a8f3fdeeefced1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64b37 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100315.680195:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefced8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100315.680209:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefced8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100315.680223:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefced8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100315.680272:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790100315.680275:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100315.680292:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefced8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100315.680315:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531c00/0x31a8f3fdeeefced1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b37 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100315.680333:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefced8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b37 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100315.680361:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:0.0:1790100315.680364:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100315.680367:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530800, rc 0) 00000100:00100000:0.0:1790100315.680433:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:5623:x1877056109415424:12345-192.168.201.18@tcp:101: Request processed in 345us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100315.680440:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000001:00100000:2.0:1790100316.450656:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00010000:00010000:3.0:1790100316.455036:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100317.414533:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126212864:0@lo:400: 00000100:00100000:0.0:1790100317.414636:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100317.414702:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100317.414709:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126212992:0@lo:400: 00000100:00100000:0.0:1790100317.414734:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.414882:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126212608:0@lo:400: 00000100:00100000:1.0:1790100317.414929:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.414957:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126213120:0@lo:400: 00000100:00100000:1.0:1790100317.414979:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.414998:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790100317.415004:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126212736:0@lo:400: 00000100:00100000:1.0:1790100317.415038:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.415053:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126213248:0@lo:400: 00000100:00100000:1.0:1790100317.415073:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.415101:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126212864 00000100:00100000:1.0:1790100317.415108:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126212864 00000100:00100000:1.0:1790100317.415151:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126213120 00000100:00100000:1.0:1790100317.415153:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126213120 00000100:00100000:1.0:1790100317.415166:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126212736 00000100:00100000:1.0:1790100317.415168:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126212736 00000100:00100000:1.0:1790100317.415186:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100317.415195:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126212864:12345-0@lo:400: 00000100:00100000:1.0:1790100317.415262:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126212864:12345-0@lo:400: Request processed in 67us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.415269:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790100317.415286:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100317.415292:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126213120:12345-0@lo:400: 00000100:00100000:1.0:1790100317.415322:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126213120:12345-0@lo:400: Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.415327:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100317.415337:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790100317.415342:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126212736:12345-0@lo:400: 00000100:00100000:1.0:1790100317.415385:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126212736:12345-0@lo:400: Request processed in 42us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.415391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790100317.415434:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126212736:0@lo:400: 00000100:00100000:1.0:1790100317.415454:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126213120:0@lo:400: 00000100:00100000:0.0:1790100317.415784:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126212608 00000100:00100000:0.0:1790100317.415790:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126212608 00000100:00100000:0.0:1790100317.415830:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790100317.415836:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126212608:12345-0@lo:400: 00000100:00100000:0.0:1790100317.415883:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126212608:12345-0@lo:400: Request processed in 48us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.415893:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1790100317.415945:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100317.415955:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126212992 00000100:00100000:3.0:1790100317.415970:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126212992 00000100:00100000:0.0:1790100317.415973:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126212864:0@lo:400: 00000100:00100000:1.0:1790100317.416235:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126212608:0@lo:400: 00000100:00100000:0.0:1790100317.417685:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126213376:0@lo:13: 00000100:00100000:2.0:1790100317.417691:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126213248 00000100:00100000:2.0:1790100317.417703:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126213248 00000100:00100000:0.0:1790100317.418004:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100317.418238:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126213376 00000100:00100000:1.0:1790100317.418247:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126213376 00000100:00100000:1.0:1790100317.418302:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100317.418311:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877056126213376:12345-0@lo:13: 00002000:00000024:1.0:1790100317.418333:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100317.418377:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877056126213376:12345-0@lo:13: Request processed in 68us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100317.418384:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790100317.419174:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787b80700 x1877056126213376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100317.419210:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790100317.419246:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126213376:0@lo:13: 00000100:00100000:3.0:1790100317.421042:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100317.421067:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126212992:12345-0@lo:400: 00000100:00100000:3.0:1790100317.421211:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126212992:12345-0@lo:400: Request processed in 154us (6474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100317.421233:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790100317.422879:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6784e40a80 x1877056126212992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.422902:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126212992:0@lo:400: 00000100:00100000:2.0:1790100317.423847:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790100317.423865:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126213248:12345-0@lo:400: 00000100:00100000:2.0:1790100317.424032:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126213248:12345-0@lo:400: Request processed in 175us (8956us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.424041:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790100317.424577:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6784e43800 x1877056126213248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100317.424594:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126213248:0@lo:400: 00000100:00080000:3.0:1790100317.424958:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100317.424966:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790100317.480887:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100317.672168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100317.672312:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109415552 00000100:00100000:2.0:1790100317.672326:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109415552 00000100:00100000:2.0:1790100317.672439:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1790100317.672453:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:5675:x1877056109415552:12345-192.168.201.18@tcp:41: 00000004:00000024:2.0:1790100317.672516:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790100317.672605:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:5675:x1877056109415552:12345-192.168.201.18@tcp:41: Request processed in 155us (453us total) trans 0 rc 0/0 00000100:00080000:3.0:1790100317.672798:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100317.672842:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:1.0:1790100317.681864:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100317.681994:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109415680 00000100:00100000:0.0:1790100317.682007:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109415680 00000100:00100000:0.0:1790100317.682107:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1790100317.682120:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:5675:x1877056109415680:12345-192.168.201.18@tcp:13: 00002000:00000024:0.0:1790100317.682173:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100317.682277:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:5675:x1877056109415680:12345-192.168.201.18@tcp:13: Request processed in 159us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100317.682286:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00080000:3.0:1790100317.682365:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100317.684473:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100317.685187:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109415808 00000100:00100000:2.0:1790100317.685203:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109415808 00000100:00100000:2.0:1790100317.685362:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1790100317.685376:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:5675:x1877056109415808:12345-192.168.201.18@tcp:13: 00002000:00000024:2.0:1790100317.685434:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100317.685545:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:5675:x1877056109415808:12345-192.168.201.18@tcp:13: Request processed in 170us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100317.685553:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00080000:3.0:1790100317.686428:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100318.439052:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126213504:0@lo:13: 00000100:00100000:0.0:1790100318.439141:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100318.439729:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126213504 00000100:00100000:2.0:1790100318.439740:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126213504 00000100:00100000:2.0:1790100318.439799:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790100318.439810:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126213504:12345-0@lo:13: 00002000:00000024:2.0:1790100318.439844:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100318.439905:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126213504:12345-0@lo:13: Request processed in 97us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100318.439948:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1790100318.446231:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d678b151500 x1877056126213504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100318.446375:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126213504:0@lo:13: 00010000:00010000:3.0:1790100318.501995:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100319.527661:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790100319.532376:0:5863:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000001:02000400:1.0:1790100319.978864:0:8300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1790100320.024946:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00010000:00010000:0.0:1790100320.550683:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100320.819580:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100320.819673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100320.819701:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100320.819728:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100320.819755:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109416064 00000100:00100000:0.0:1790100320.819767:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109416064 00000100:00100000:0.0:1790100320.819836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:0.0:1790100320.819847:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109416064:12345-192.168.201.18@tcp:400: 00000100:00100000:0.0:1790100320.819930:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109416064:12345-192.168.201.18@tcp:400: Request processed in 84us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100320.819937:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:0.0:1790100320.819978:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109416320 00000100:00100000:0.0:1790100320.819982:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109416320 00000100:00100000:0.0:1790100320.820006:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109416192 00000100:00100000:0.0:1790100320.820009:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109416192 00000100:00100000:0.0:1790100320.820025:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1790100320.820031:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109416320:12345-192.168.201.18@tcp:400: 00000100:00100000:0.0:1790100320.820060:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109416320:12345-192.168.201.18@tcp:400: Request processed in 29us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100320.820066:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1790100320.820078:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1790100320.820084:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109416192:12345-192.168.201.18@tcp:400: 00000100:00100000:0.0:1790100320.820108:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109416192:12345-192.168.201.18@tcp:400: Request processed in 24us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100320.820114:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00080000:0.0:1790100320.820132:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100320.820136:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100320.820139:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100320.824349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109415936 00000100:00100000:3.0:1790100320.824366:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109415936 00000100:00100000:3.0:1790100320.826372:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:3.0:1790100320.826390:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109415936:12345-192.168.201.18@tcp:400: 00000100:00100000:3.0:1790100320.826480:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109415936:12345-192.168.201.18@tcp:400: Request processed in 95us (6906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100320.826488:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 127 00010000:00010000:1.0:1790100321.573927:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100322.538405:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100322.538435:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126213632:0@lo:13: 00000100:00100000:0.0:1790100322.538511:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100322.538653:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126213632 00000100:00100000:2.0:1790100322.538662:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126213632 00000100:00100000:2.0:1790100322.538728:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100322.538739:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126213632:12345-0@lo:13: 00002000:00000024:2.0:1790100322.538777:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100322.538783:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126213888:0@lo:400: 00000100:00100000:1.0:1790100322.538827:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100322.538851:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126213632:12345-0@lo:13: Request processed in 114us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100322.538861:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790100322.538861:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100322.538872:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126214016:0@lo:400: 00000100:00100000:1.0:1790100322.538901:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100322.538943:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126213888 00000100:00100000:1.0:1790100322.538947:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126213888 00000100:00100000:1.0:1790100322.538981:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126214016 00000100:00100000:1.0:1790100322.538984:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126214016 00000100:00100000:2.0:1790100322.538993:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100322.539003:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126213888:12345-0@lo:400: 00000100:00100000:1.0:1790100322.539013:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790100322.539023:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126214016:12345-0@lo:400: 00000100:00100000:2.0:1790100322.539060:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126213888:12345-0@lo:400: Request processed in 59us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100322.539069:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126214016:12345-0@lo:400: Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100322.539070:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790100322.539081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790100322.539132:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126214016:0@lo:400: 00000100:00100000:1.0:1790100322.539179:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126213888:0@lo:400: 00000100:00100000:3.0:1790100322.539264:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126214144:0@lo:400: 00000100:00100000:3.0:1790100322.539298:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100322.539330:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790100322.539336:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126213760:0@lo:400: 00000100:00100000:3.0:1790100322.539362:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100322.539393:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126214272:0@lo:400: 00000100:00100000:3.0:1790100322.539414:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100322.539438:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126214272 00000100:00100000:3.0:1790100322.539442:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126214272 00000100:00100000:3.0:1790100322.539468:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790100322.539475:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126214272:12345-0@lo:400: 00000100:00100000:3.0:1790100322.539509:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126214272:12345-0@lo:400: Request processed in 35us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100322.539516:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790100322.539543:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126214272:0@lo:400: 00000100:00100000:2.0:1790100322.539564:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126213760 00000100:00100000:2.0:1790100322.539570:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126213760 00000100:00080000:0.0:1790100322.539637:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100322.539644:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100322.539646:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790100322.539657:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126213760:12345-0@lo:400: 00010000:00080000:0.0:1790100322.539672:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787b80380 x1877056126213632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100322.539692:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126213632:0@lo:13: 00000100:00100000:2.0:1790100322.539699:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126213760:12345-0@lo:400: Request processed in 43us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100322.539706:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1790100322.539773:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126214144 00000100:00100000:1.0:1790100322.539778:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126214144 00000100:00100000:3.0:1790100322.539827:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126213760:0@lo:400: 00000100:00100000:1.0:1790100322.539836:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100322.539846:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126214144:12345-0@lo:400: 00000100:00100000:1.0:1790100322.539894:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126214144:12345-0@lo:400: Request processed in 50us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100322.539900:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790100322.540072:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790100322.542067:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67852cc700 x1877056126214144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100322.542101:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126214144:0@lo:400: 00010000:00010000:0.0:1790100322.600525:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790100323.027819:0:8450:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd017a130 20000000:00000080:1.0:1790100323.027845:0:8450:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d67ae5fbc00 uarg=0000000000000000 20000000:01000000:1.0:1790100323.027881:0:8450:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1790100323.027884:0:8450:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1790100323.027887:0:8450:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790100323.027893:0:8450:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1790100323.027898:0:8450:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1790100323.027912:0:8450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790100323.027915:0:8450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790100323.028119:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790100323.028122:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790100323.030045:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1790100323.030638:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1790100323.030708:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1790100323.030744:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1790100323.030757:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790100323.030760:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790100323.032605:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1790100323.033779:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1790100323.033835:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1790100323.033889:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1790100323.033904:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790100323.033907:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790100323.035095:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1790100323.036106:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1790100323.036175:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1790100323.036224:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1790100323.036244:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790100323.036355:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790100323.041328:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1790100323.042145:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1790100323.042218:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1790100323.042439:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1790100323.042463:0:8450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790100323.042485:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042503:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdd5 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042511:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdff expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042518:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce29 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042525:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce37 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042533:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce45 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042540:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce61 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042548:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefce8b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042558:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ad5 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042574:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64adc expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042582:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042766:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64adc expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042783:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64adc expref: 9 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.042800:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214400:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100323.042943:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ad5 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.042962:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ad5 expref: 9 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.042971:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214528:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100323.043001:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefce8b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.043009:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce8b expref: 18 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.043017:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214656:0@lo:104: 00000100:00100000:2.0:1790100323.043055:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100323.043143:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefce61 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.043151:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce61 expref: 18 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.043159:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214784:0@lo:104: 00000100:00100000:2.0:1790100323.043184:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100323.043908:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefce45 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.043919:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce45 expref: 18 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.043927:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214912:0@lo:104: 00010000:00010000:2.0:1790100323.043970:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefce37 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.043977:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce37 expref: 18 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.043984:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126215040:0@lo:104: 00010000:00010000:2.0:1790100323.044007:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefce29 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.044014:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce29 expref: 18 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.044021:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126215168:0@lo:104: 00010000:00010000:2.0:1790100323.044042:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcdff expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.044059:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdff expref: 18 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.044067:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126215296:0@lo:104: 00010000:00010000:2.0:1790100323.044089:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcdd5 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.044096:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdd5 expref: 18 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.044104:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126215424:0@lo:104: 00000100:00100000:2.0:1790100323.044121:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1790100323.044245:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790100323.044378:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100323.044590:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100323.044644:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126214656 00000100:00100000:3.0:1790100323.044653:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126214656 00000100:00100000:3.0:1790100323.044691:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126214784 00000100:00100000:3.0:1790100323.044694:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126214784 00000100:00100000:3.0:1790100323.044704:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126214912 00000100:00100000:3.0:1790100323.044706:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126214912 00000100:00100000:3.0:1790100323.044718:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100323.044726:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+5:8450:x1877056126214656:12345-0@lo:104: 00010000:00010000:3.0:1790100323.044739:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.044803:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100323.044809:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+5:8450:x1877056126214656:12345-0@lo:104: Request processed in 84us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100323.044817:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100323.044834:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100323.044840:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:8450:x1877056126214784:12345-0@lo:104: 00010000:00010000:3.0:1790100323.044847:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.044883:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790100323.044888:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:8450:x1877056126214784:12345-0@lo:104: Request processed in 49us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100323.044893:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100323.044925:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790100323.044932:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8450:x1877056126214912:12345-0@lo:104: 00010000:00010000:3.0:1790100323.044960:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.044987:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790100323.044992:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8450:x1877056126214912:12345-0@lo:104: Request processed in 62us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100323.044997:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1790100323.045016:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790100323.045023:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045030:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523c00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1790100323.045034:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045043:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100323.045050:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100323.045055:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100323.045088:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045094:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100323.045112:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045119:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781523c00/0x31a8f3fdeeefce8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045148:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100323.045152:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045157:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780030400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1790100323.045160:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045166:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100323.045172:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100323.045177:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100323.045190:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045196:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100323.045201:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045208:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6780030400/0x31a8f3fdeeefce61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045217:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100323.045220:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045236:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fee00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1790100323.045239:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045245:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100323.045251:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100323.045256:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100323.045268:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045273:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100323.045287:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045294:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefce45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.045305:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100323.045307:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100323.045309:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100323.045322:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126215808:0@lo:103: 00000100:00100000:3.0:1790100323.045355:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100323.045786:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100323.046347:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214656:0@lo:104: 00000100:00100000:2.0:1790100323.046358:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214784:0@lo:104: 00000100:00100000:2.0:1790100323.046365:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214912:0@lo:104: 00000100:00100000:1.0:1790100323.046641:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100323.047794:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126215680:0@lo:103: 00000100:00100000:0.0:1790100323.047857:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100323.047909:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100323.047917:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126215552:0@lo:103: 00000100:00100000:0.0:1790100323.047938:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100323.048028:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126215808 00000100:00100000:3.0:1790100323.048044:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126215808 00010000:00010000:3.0:1790100323.048106:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce45 expref: 19 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100323.048162:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126215680 00000100:00100000:3.0:1790100323.048166:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126215680 00010000:00010000:3.0:1790100323.048180:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce61 expref: 20 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100323.048191:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126215552 00000100:00100000:3.0:1790100323.048193:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126215552 00010000:00010000:3.0:1790100323.048203:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce8b expref: 21 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100323.048216:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100323.048242:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+21:3313:x1877056126215808:12345-0@lo:103: 00010000:00010000:3.0:1790100323.048268:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100323.048274:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce45 expref: 21 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.048286:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce45 expref: 21 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.048310:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefce4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefce45 expref: 21 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.048331:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100323.048417:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+20:3313:x1877056126215808:12345-0@lo:103: Request processed in 192us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100323.048425:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100323.048445:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100323.048451:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126215680:12345-0@lo:103: 00010000:00010000:3.0:1790100323.048468:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100323.048473:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce61 expref: 19 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.048480:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce61 expref: 19 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.048490:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefce68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefce61 expref: 19 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.048500:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100323.048535:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:3312:x1877056126215680:12345-0@lo:103: Request processed in 84us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100323.048542:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100323.048554:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790100323.048560:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3312:x1877056126215552:12345-0@lo:103: 00010000:00010000:3.0:1790100323.048568:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100323.048572:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce8b expref: 17 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.048580:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce8b expref: 17 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.048590:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780030200/0x31a8f3fdeeefce92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefce8b expref: 17 pid: 5836 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.048601:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100323.048654:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3312:x1877056126215552:12345-0@lo:103: Request processed in 94us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100323.048669:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790100323.048721:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126215552:0@lo:103: 00000100:00100000:3.0:1790100323.048731:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126215680:0@lo:103: 00000100:00100000:0.0:1790100323.049090:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126215808:0@lo:103: 00000100:00100000:3.0:1790100323.049978:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100323.050018:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100323.050064:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109416576 00000100:00100000:0.0:1790100323.050065:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109416448 00000100:00100000:3.0:1790100323.050075:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109416576 00000100:00100000:0.0:1790100323.050077:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109416448 00010000:00010000:3.0:1790100323.050121:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ad5 expref: 11 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100323.050124:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64adc expref: 11 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100323.050197:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1790100323.050220:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:2358:x1877056109416576:12345-192.168.201.18@tcp:103: 00000100:00100000:0.0:1790100323.050221:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1790100323.050240:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:2358:x1877056109416448:12345-192.168.201.18@tcp:103: 00010000:00010000:0.0:1790100323.050262:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100323.050266:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100323.050272:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64adc expref: 11 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.050279:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ad5 expref: 11 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100323.050305:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64adc expref: 11 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100323.050503:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100323.050683:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ad5 expref: 11 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.050708:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100323.050773:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:2358:x1877056109416576:12345-192.168.201.18@tcp:103: Request processed in 567us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100323.050782:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1790100323.052015:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214400:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100323.052035:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781523400/0x31a8f3fdeeefcea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ad5 expref: 10 pid: 5834 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100323.052077:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126214528:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100323.052103:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64adc expref: 9 pid: 5836 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100323.052157:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100323.052235:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:2358:x1877056109416448:12345-192.168.201.18@tcp:103: Request processed in 2002us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100323.052243:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1790100323.053224:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126215040 00000100:00100000:2.0:1790100323.053235:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126215040 00000100:00100000:2.0:1790100323.053331:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126215168 00000100:00100000:2.0:1790100323.053335:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126215168 00000100:00100000:2.0:1790100323.053358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100323.053428:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:8450:x1877056126215040:12345-0@lo:104: 00010000:00010000:2.0:1790100323.053447:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.053587:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100323.053594:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:8450:x1877056126215040:12345-0@lo:104: Request processed in 170us (9003us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100323.053639:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100323.053656:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790100323.053662:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8450:x1877056126215168:12345-0@lo:104: 00010000:00010000:2.0:1790100323.053669:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.053704:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790100323.053709:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8450:x1877056126215168:12345-0@lo:104: Request processed in 48us (7070us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100323.053714:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1790100323.053780:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100323.053786:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.053793:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523000 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100323.053797:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.053806:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100323.053813:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100323.053818:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100323.053855:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.053861:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100323.053886:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.053894:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781523000/0x31a8f3fdeeefce37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce3e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.053906:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100323.053909:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.053915:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf530000 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100323.053917:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.053923:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100323.053929:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100323.053934:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100323.054021:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.054027:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100323.054043:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.054049:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67bf530000/0x31a8f3fdeeefce29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.054059:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100323.054066:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100323.054068:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100323.054083:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126215936:0@lo:103: 00000100:00100000:2.0:1790100323.054146:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100323.054195:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126216064:0@lo:103: 00000100:00100000:2.0:1790100323.054220:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100323.054351:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100323.054459:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126215936 00000100:00100000:2.0:1790100323.054467:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126215936 00010000:00010000:2.0:1790100323.054492:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce37 expref: 16 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.054522:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126216064 00000100:00100000:2.0:1790100323.054525:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126216064 00010000:00010000:2.0:1790100323.054538:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce29 expref: 17 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100323.054551:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790100323.054557:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3314:x1877056126215936:12345-0@lo:103: 00010000:00010000:2.0:1790100323.054568:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100323.054572:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce37 expref: 17 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.054583:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce37 expref: 17 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.054600:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100323.054661:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3314:x1877056126215936:12345-0@lo:103: Request processed in 103us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100323.054668:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790100323.054681:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100323.054694:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3311:x1877056126216064:12345-0@lo:103: 00010000:00010000:2.0:1790100323.054702:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100323.054706:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce29 expref: 16 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.054714:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefce29 expref: 16 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100323.054722:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100323.054746:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3311:x1877056126216064:12345-0@lo:103: Request processed in 53us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100323.054752:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100323.054810:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126215936:0@lo:103: 00000100:00100000:2.0:1790100323.054831:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126216064:0@lo:103: 00000100:00100000:1.0:1790100323.054922:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100323.054931:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126215296 00000100:00100000:1.0:1790100323.054935:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126215296 00000100:00100000:1.0:1790100323.054965:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126215424 00000100:00100000:1.0:1790100323.054968:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126215424 00000100:00100000:1.0:1790100323.054980:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100323.054986:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+4:8450:x1877056126215296:12345-0@lo:104: 00010000:00010000:1.0:1790100323.054995:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055043:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100323.055049:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+4:8450:x1877056126215296:12345-0@lo:104: Request processed in 64us (4547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100323.055056:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100323.055069:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790100323.055075:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8450:x1877056126215424:12345-0@lo:104: 00010000:00010000:1.0:1790100323.055082:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055112:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790100323.055116:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8450:x1877056126215424:12345-0@lo:104: Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100323.055122:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1790100323.055179:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100323.055184:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055191:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21ff600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100323.055194:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055202:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100323.055209:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100323.055215:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100323.055247:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055651:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100323.055667:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055675:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff600/0x31a8f3fdeeefcdff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefce06 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055688:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100323.055692:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055698:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781656200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100323.055702:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055708:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100323.055715:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100323.055721:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100323.055735:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055740:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100323.055750:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055767:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781656200/0x31a8f3fdeeefcdd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcddc expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.055781:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100323.055783:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100323.055785:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100323.055793:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100323.055804:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126216192:0@lo:103: 00000100:00100000:1.0:1790100323.055840:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100323.055883:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126216320:0@lo:103: 00000100:00100000:1.0:1790100323.055905:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790100323.055929:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100323.055938:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126216192 00000100:00100000:0.0:1790100323.056046:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126216320 00000100:00100000:0.0:1790100323.056051:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126216320 00010000:00010000:0.0:1790100323.056076:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdd5 expref: 16 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100323.056095:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790100323.056102:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3313:x1877056126216320:12345-0@lo:103: 00010000:00010000:0.0:1790100323.056112:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100323.056117:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdd5 expref: 16 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100323.056136:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdd5 expref: 16 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100323.056149:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100323.056183:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3313:x1877056126216320:12345-0@lo:103: Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100323.056190:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790100323.056283:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126216192 00010000:00010000:1.0:1790100323.056301:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdff expref: 16 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100323.056356:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790100323.056372:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3311:x1877056126216192:12345-0@lo:103: 00010000:00010000:1.0:1790100323.056381:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100323.056385:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdff expref: 16 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056395:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdff expref: 16 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056408:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056426:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056440:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056448:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056454:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056461:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056466:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781657200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100323.056470:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056477:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056486:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100323.056495:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100323.056537:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3311:x1877056126216192:12345-0@lo:103: Request processed in 174us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100323.056543:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100323.056598:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126216192:0@lo:103: 00010000:00010000:3.0:1790100323.056757:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefce3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefce37 expref: 15 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100323.056770:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126215040:0@lo:104: 00010000:00010000:3.0:1790100323.056781:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781522c00/0x31a8f3fdeeefce30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefce29 expref: 14 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100323.056790:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126215168:0@lo:104: 00010000:00010000:3.0:1790100323.056799:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefce06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdff expref: 13 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100323.056808:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126215296:0@lo:104: 00010000:00010000:3.0:1790100323.056816:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf530c00/0x31a8f3fdeeefcddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdd5 expref: 12 pid: 5835 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100323.056824:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1877056126215424:0@lo:104: 00010000:00010000:3.0:1790100323.056855:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.056865:0:8450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.056872:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100323.056879:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcedf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100323.060602:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126216320:0@lo:103: 00000100:00100000:2.0:1790100323.559263:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126216448:0@lo:13: 00000100:00100000:2.0:1790100323.559339:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100323.559548:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126216448 00000100:00100000:3.0:1790100323.559557:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126216448 00000100:00100000:3.0:1790100323.559723:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100323.559736:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126216448:12345-0@lo:13: 00002000:00000024:3.0:1790100323.559769:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100323.559824:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126216448:12345-0@lo:13: Request processed in 91us (485us total) trans 0 rc 0/0 00010000:00080000:0.0:1790100323.559885:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad885880 x1877056126216448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100323.559915:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126216448:0@lo:13: 00000100:00100000:3.0:1790100323.563355:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1790100323.621759:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100324.646094:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790100325.029851:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790100325.029857:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6787677800 from 39 10000000:01000000:1.0:1790100325.029862:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100325.029909:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100325.029918:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100325.029926:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100325.029946:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126216576:0@lo:101: 00000100:00100000:1.0:1790100325.030018:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100325.030140:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678760b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.030456:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126216576 00000100:00100000:3.0:1790100325.030466:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126216576 00000100:00100000:3.0:1790100325.030518:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790100325.030529:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+12:5838:x1877056126216576:12345-0@lo:101: 00010000:00010000:3.0:1790100325.030543:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100325.030557:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67900afc00/0x31a8f3fdeeefceed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcee6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.030580:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900afc00/0x31a8f3fdeeefceed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcee6 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.030592:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67900afc00/0x31a8f3fdeeefceed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcee6 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.030603:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900afc00, rc 0) 00000100:00100000:3.0:1790100325.030674:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126216576:12345-0@lo:101: Request processed in 147us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100325.030682:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790100325.030796:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126216576:0@lo:101: 00010000:00010000:1.0:1790100325.030808:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100325.030814:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100325.030856:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126216704:0@lo:501: 00000100:00100000:1.0:1790100325.030876:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100325.030898:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678760b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.030983:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126216704 00000100:00100000:3.0:1790100325.031001:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126216704 00000100:00100000:3.0:1790100325.031032:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790100325.031039:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126216704:12345-0@lo:501: 00000100:00100000:3.0:1790100325.031291:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126216704:12345-0@lo:501: Request processed in 251us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100325.031298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790100325.031459:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126216704:0@lo:501: 00000100:00100000:1.0:1790100325.031497:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126216832:0@lo:503: 00000100:00100000:1.0:1790100325.031535:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100325.031556:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678760b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.031603:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126216832 00000100:00100000:3.0:1790100325.031607:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126216832 00000100:00100000:3.0:1790100325.031656:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790100325.031663:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126216832:12345-0@lo:503: 00000100:00100000:3.0:1790100325.031842:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126216832:12345-0@lo:503: Request processed in 179us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100325.031849:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790100325.036444:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126216832:0@lo:503: 00000100:00100000:1.0:1790100325.038911:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8469:1877056126216960:0@lo:502: 00000100:00100000:1.0:1790100325.038995:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100325.039039:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678760bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100325.039126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126216960 00000100:00100000:2.0:1790100325.039135:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126216960 00000100:00100000:2.0:1790100325.039196:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790100325.039205:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:8469:x1877056126216960:12345-0@lo:502: 00000100:00100000:2.0:1790100325.039488:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:8469:x1877056126216960:12345-0@lo:502: Request processed in 284us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.039496:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790100325.039688:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8469:1877056126216960:0@lo:502: 00000100:00100000:1.0:1790100325.039734:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8469:1877056126217088:0@lo:502: 00000100:00100000:1.0:1790100325.039769:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100325.039801:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678760bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100325.039834:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126217088 00000100:00100000:0.0:1790100325.039847:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126217088 00000100:00100000:0.0:1790100325.039881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790100325.039889:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:8469:x1877056126217088:12345-0@lo:502: 00000100:00100000:0.0:1790100325.040062:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+13:8469:x1877056126217088:12345-0@lo:502: Request processed in 173us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.040069:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790100325.040112:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8469:1877056126217088:0@lo:502: 00000040:00080000:1.0:1790100325.040134:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790100325.040358:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790100325.040381:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790100325.040398:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.040502:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100325.040515:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1790100325.040518:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1790100325.040521:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790100325.040547:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.040555:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.040566:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100325.040580:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217216:0@lo:101: 00000100:00100000:2.0:1790100325.040647:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.040677:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100325.043326:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126217216 00000100:00100000:0.0:1790100325.043341:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126217216 00000100:00100000:0.0:1790100325.043469:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790100325.043481:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+13:5838:x1877056126217216:12345-0@lo:101: 00010000:00010000:0.0:1790100325.043498:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100325.043516:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcefb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcef4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.043545:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcefb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcef4 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.043556:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcefb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcef4 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.043565:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530600, rc 0) 00000100:00100000:0.0:1790100325.043669:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126217216:12345-0@lo:101: Request processed in 190us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.043676:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790100325.043722:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217216:0@lo:101: 00010000:00010000:2.0:1790100325.043742:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.043753:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100325.043819:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217344:0@lo:501: 00000100:00100000:2.0:1790100325.043869:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.045743:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.060757:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126217344 00000100:00100000:3.0:1790100325.060774:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126217344 00000100:00100000:3.0:1790100325.060834:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790100325.060843:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126217344:12345-0@lo:501: 00000100:00100000:3.0:1790100325.061186:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126217344:12345-0@lo:501: Request processed in 343us (17315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100325.061193:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790100325.062109:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217344:0@lo:501: 00000100:00100000:2.0:1790100325.062171:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217472:0@lo:503: 00000100:00100000:2.0:1790100325.062223:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.062267:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.063473:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126217472 00000100:00100000:3.0:1790100325.063486:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126217472 00000100:00100000:3.0:1790100325.063530:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790100325.063540:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126217472:12345-0@lo:503: 00000100:00100000:3.0:1790100325.063817:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126217472:12345-0@lo:503: Request processed in 277us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100325.063825:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1790100325.064306:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217472:0@lo:503: 00000100:00100000:2.0:1790100325.064740:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8470:1877056126217600:0@lo:502: 00000100:00100000:2.0:1790100325.064790:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.064827:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.065360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126217600 00000100:00100000:3.0:1790100325.065369:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126217600 00000100:00100000:3.0:1790100325.065410:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790100325.065419:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:8470:x1877056126217600:12345-0@lo:502: 00000100:00100000:3.0:1790100325.065652:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+14:8470:x1877056126217600:12345-0@lo:502: Request processed in 232us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100325.065661:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1790100325.065667:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8470:1877056126217600:0@lo:502: 00000020:01000000:2.0:1790100325.065697:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100325.065706:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100325.065709:0:8470:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790100325.065714:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790100325.065738:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8470:1877056126217728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100325.065775:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.065796:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100325.065852:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126217728 00000100:00100000:0.0:1790100325.065856:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126217728 00000100:00100000:0.0:1790100325.065888:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790100325.065896:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:8470:x1877056126217728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100325.066065:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+14:8470:x1877056126217728:12345-0@lo:502:llog_process_th.0 Request processed in 170us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.066077:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790100325.066163:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8470:1877056126217728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100325.066180:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100325.066183:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100325.066185:0:8470:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790100325.066188:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1790100325.067074:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1790100325.067109:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790100325.067120:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.067132:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100325.067142:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790100325.067145:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67ad888800 from 39 10000000:01000000:3.0:1790100325.067148:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790100325.067178:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.067186:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.067196:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100325.067214:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.067253:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.067305:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100325.068678:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126217856 00000100:00100000:1.0:1790100325.068691:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126217856 00000100:00100000:1.0:1790100325.068776:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790100325.068785:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:5838:x1877056126217856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100325.068799:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100325.068816:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780030400/0x31a8f3fdeeefcf09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcf02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100325.068842:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780030400/0x31a8f3fdeeefcf09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf02 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100325.068853:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780030400/0x31a8f3fdeeefcf09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf02 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100325.068883:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780030400, rc 0) 00000100:00100000:1.0:1790100325.068943:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126217856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100325.068949:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790100325.069065:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100325.069082:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.069106:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100325.069175:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100325.069207:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.069382:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.071289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126217984 00000100:00100000:3.0:1790100325.071303:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126217984 00000100:00100000:2.0:1790100325.072665:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790100325.072687:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126217984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100325.073076:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126217984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.073085:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790100325.073205:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126217984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.073259:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126218112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.073305:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.073346:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0439c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100325.073406:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126218112 00000100:00100000:0.0:1790100325.073413:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126218112 00000100:00100000:0.0:1790100325.073478:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790100325.073486:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126218112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100325.073668:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126218112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.073675:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790100325.073813:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126218112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.074048:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8471:1877056126218240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100325.074079:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.074437:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100325.074478:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126218240 00000100:00100000:2.0:1790100325.074485:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126218240 00000100:00100000:2.0:1790100325.074578:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790100325.074586:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:8471:x1877056126218240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100325.074841:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:8471:x1877056126218240:12345-0@lo:502:llog_process_th.0 Request processed in 255us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.074848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790100325.075002:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8471:1877056126218240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100325.075047:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8471:1877056126218368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100325.075082:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.075147:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100325.075184:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126218368 00000100:00100000:2.0:1790100325.075189:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126218368 00000100:00100000:2.0:1790100325.075253:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790100325.075260:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:8471:x1877056126218368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100325.075408:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+15:8471:x1877056126218368:12345-0@lo:502:llog_process_th.0 Request processed in 149us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.075415:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790100325.075483:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8471:1877056126218368:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790100325.075518:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790100325.075585:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790100325.075602:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790100325.075644:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.075656:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100325.075665:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790100325.075673:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1790100325.075677:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790100325.075706:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.075714:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.075724:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100325.075737:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126218496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.075764:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100325.081204:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126218496 00000100:00100000:0.0:1790100325.081227:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126218496 00000100:00100000:0.0:1790100325.082315:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790100325.082327:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+15:5838:x1877056126218496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100325.082344:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100325.082363:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf530a00/0x31a8f3fdeeefcf17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcf10 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.082391:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf530a00/0x31a8f3fdeeefcf17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf10 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.082402:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf530a00/0x31a8f3fdeeefcf17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf10 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.082411:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530a00, rc 0) 00000100:00100000:0.0:1790100325.082479:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126218496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (6714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.082486:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790100325.082865:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.082891:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126218496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100325.082908:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.082917:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100325.082984:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126218624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.083019:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.083083:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100325.083193:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126218624 00000100:00100000:0.0:1790100325.083211:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126218624 00000100:00100000:0.0:1790100325.083327:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790100325.083336:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126218624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100325.083601:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126218624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.083608:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790100325.083704:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126218624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.083733:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126218752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.083769:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.083951:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100325.083985:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126218752 00000100:00100000:2.0:1790100325.083990:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126218752 00000100:00100000:2.0:1790100325.084012:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790100325.084019:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126218752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100325.085532:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126218752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1507us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.085545:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790100325.085910:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126218752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100325.087201:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8472:1877056126218880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100325.087275:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.087316:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100325.087360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126218880 00000100:00100000:1.0:1790100325.087368:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126218880 00000100:00100000:1.0:1790100325.087426:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790100325.087435:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+16:8472:x1877056126218880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100325.087670:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+16:8472:x1877056126218880:12345-0@lo:502:llog_process_th.0 Request processed in 236us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100325.087677:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790100325.088131:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8472:1877056126218880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790100325.088172:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100325.088186:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100325.088189:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790100325.088195:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790100325.088221:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8472:1877056126219008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100325.088272:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.088300:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100325.088308:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126219008 00000100:00100000:1.0:1790100325.088313:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126219008 00000100:00100000:1.0:1790100325.088383:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790100325.088391:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+16:8472:x1877056126219008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100325.088544:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+16:8472:x1877056126219008:12345-0@lo:502:llog_process_th.0 Request processed in 154us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100325.088551:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790100325.088987:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8472:1877056126219008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790100325.089009:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100325.089014:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100325.089016:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790100325.089020:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1790100325.089115:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1790100325.089133:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790100325.089143:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.089154:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100325.089163:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790100325.089166:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6788844800 from 39 10000000:01000000:0.0:1790100325.089169:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790100325.089194:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.089203:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.089212:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100325.089228:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100325.089262:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100325.089295:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f82900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100325.089346:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126219136 00000100:00100000:2.0:1790100325.089352:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126219136 00000100:00100000:2.0:1790100325.089386:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790100325.089394:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126219136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100325.089403:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100325.089425:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781657c00/0x31a8f3fdeeefcf25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcf1e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.089446:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781657c00/0x31a8f3fdeeefcf25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf1e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.089456:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781657c00/0x31a8f3fdeeefcf25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf1e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.089462:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781657c00, rc 0) 00000100:00100000:2.0:1790100325.089492:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126219136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.089497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790100325.089560:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100325.089570:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.089575:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100325.089636:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100325.089658:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100325.089670:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f82900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100325.089712:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126219264 00000100:00100000:2.0:1790100325.089715:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126219264 00000100:00100000:2.0:1790100325.089736:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790100325.089740:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126219264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100325.089909:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126219264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.089916:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790100325.089933:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.089961:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.089996:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.090027:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100325.090069:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126219392 00000100:00100000:2.0:1790100325.090072:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126219392 00000100:00100000:2.0:1790100325.090109:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790100325.090116:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126219392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100325.090386:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126219392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.090392:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790100325.090458:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.091980:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8473:1877056126219520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100325.092051:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.092101:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043000 going to sleep for 11 seconds 00000100:00100000:0.0:1790100325.092125:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126219520 00000100:00100000:0.0:1790100325.092133:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126219520 00000100:00100000:0.0:1790100325.092177:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790100325.092186:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:8473:x1877056126219520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100325.092401:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:8473:x1877056126219520:12345-0@lo:502:llog_process_th.0 Request processed in 216us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.092408:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790100325.093687:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8473:1877056126219520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100325.093757:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8473:1877056126219648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100325.093890:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.094049:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787750840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100325.094084:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126219648 00000100:00100000:0.0:1790100325.094100:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126219648 00000100:00100000:0.0:1790100325.094171:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790100325.094181:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:8473:x1877056126219648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100325.094392:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:8473:x1877056126219648:12345-0@lo:502:llog_process_th.0 Request processed in 212us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.094399:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790100325.094594:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8473:1877056126219648:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790100325.094635:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790100325.094746:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790100325.094765:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100325.094775:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.094793:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100325.094803:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790100325.094805:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1790100325.094807:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790100325.094835:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.094843:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.094851:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100325.094867:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100325.094899:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100325.095017:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788d92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.095628:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126219776 00000100:00100000:3.0:1790100325.095637:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126219776 00000100:00100000:3.0:1790100325.095680:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790100325.095690:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126219776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100325.095703:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100325.095718:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67900afa00/0x31a8f3fdeeefcf33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.095742:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900afa00/0x31a8f3fdeeefcf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf2c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.095751:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67900afa00/0x31a8f3fdeeefcf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf2c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100325.095760:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900afa00, rc 0) 00000100:00100000:3.0:1790100325.095806:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126219776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100325.095812:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790100325.095958:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100325.095973:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.095982:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100325.096036:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100325.096064:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100325.096120:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788d92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.096167:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126219904 00000100:00100000:3.0:1790100325.096172:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126219904 00000100:00100000:3.0:1790100325.096203:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790100325.096209:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126219904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.096774:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126219904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 563us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100325.096782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790100325.096855:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126219904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100325.096887:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126220032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100325.096924:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100325.096953:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788d92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.096997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126220032 00000100:00100000:3.0:1790100325.097008:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126220032 00000100:00100000:3.0:1790100325.097076:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790100325.097083:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126220032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100325.097248:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126220032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100325.097255:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790100325.097860:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126220032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100325.098508:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8474:1877056126220160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100325.098566:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.098658:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.099383:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126220160 00000100:00100000:3.0:1790100325.099391:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126220160 00000100:00100000:3.0:1790100325.099431:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790100325.099442:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8474:x1877056126220160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100325.101799:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8474:x1877056126220160:12345-0@lo:502:llog_process_th.0 Request processed in 2351us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.101812:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790100325.101924:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8474:1877056126220160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100325.101962:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100325.101971:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100325.101974:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790100325.101979:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790100325.102021:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8474:1877056126220288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100325.102079:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100325.102123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126220288 00000100:00100000:0.0:1790100325.102123:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788d92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100325.102131:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126220288 00000100:00100000:3.0:1790100325.102171:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790100325.102180:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8474:x1877056126220288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100325.103166:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8474:x1877056126220288:12345-0@lo:502:llog_process_th.0 Request processed in 984us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.103176:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790100325.103373:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8474:1877056126220288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100325.103399:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100325.103404:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100325.103407:0:8474:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790100325.103410:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790100325.103746:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1790100325.103774:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790100325.103783:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.103795:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100325.103806:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790100325.103808:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d6784edb380 from 1 10000000:01000000:2.0:1790100325.103811:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790100325.103842:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.103851:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.103861:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100325.103879:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126220416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790100325.103916:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.104231:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100325.104317:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126220416 00000100:00100000:0.0:1790100325.104324:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126220416 00000100:00100000:0.0:1790100325.104371:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790100325.104380:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126220416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100325.104392:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100325.104404:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf531e00/0x31a8f3fdeeefcf41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcf3a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.104517:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf531e00/0x31a8f3fdeeefcf41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf3a expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.104529:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf531e00/0x31a8f3fdeeefcf41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf3a expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100325.104538:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf531e00, rc 0) 00000100:00100000:0.0:1790100325.104638:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126220416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.104645:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790100325.104715:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126220416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100325.104727:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.104736:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100325.104783:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126220544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100325.104816:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100325.104875:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100325.104906:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126220544 00000100:00100000:0.0:1790100325.104910:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126220544 00000100:00100000:0.0:1790100325.104935:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790100325.104942:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126220544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100325.105552:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126220544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 608us (732us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100325.105560:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790100325.105853:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126220544:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1790100325.105887:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790100325.105895:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100325.105903:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100325.670031:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100325.933707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100325.933741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100325.933786:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100325.933796:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109416704 00000100:00100000:0.0:1790100325.933808:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109416704 00000100:00100000:3.0:1790100325.933895:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100325.933935:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00100000:0.0:1790100325.933948:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:2360:x1877056109416704:12345-192.168.201.18@tcp:400: 00000100:00100000:2.0:1790100325.933998:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109416832 00000100:00100000:2.0:1790100325.934003:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109416832 00000100:00100000:0.0:1790100325.934037:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:2360:x1877056109416704:12345-192.168.201.18@tcp:400: Request processed in 90us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100325.934045:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00100000:2.0:1790100325.934056:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1790100325.934066:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109416832:12345-192.168.201.18@tcp:400: 00000100:00080000:0.0:1790100325.934112:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100325.934116:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109416832:12345-192.168.201.18@tcp:400: Request processed in 50us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100325.934124:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:1.0:1790100325.935478:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109416960 00000100:00100000:1.0:1790100325.935490:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109416960 00000100:00100000:3.0:1790100325.935501:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109417088 00000100:00100000:3.0:1790100325.935508:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109417088 00000100:00080000:0.0:1790100325.935587:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100325.935604:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100325.935739:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:1.0:1790100325.935751:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2360:x1877056109416960:12345-192.168.201.18@tcp:400: 00000100:00100000:1.0:1790100325.935814:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2360:x1877056109416960:12345-192.168.201.18@tcp:400: Request processed in 67us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100325.935830:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:1.0:1790100325.935846:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1790100325.935853:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2360:x1877056109417088:12345-192.168.201.18@tcp:400: 00000100:00100000:1.0:1790100325.935877:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2360:x1877056109417088:12345-192.168.201.18@tcp:400: Request processed in 25us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100325.936036:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00010000:00010000:1.0:1790100326.694007:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100327.654095:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126220672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100327.654173:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100327.654378:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126220672 00000100:00100000:2.0:1790100327.654388:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126220672 00000100:00100000:2.0:1790100327.654467:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790100327.654478:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126220672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100327.654514:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100327.654562:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126220672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100327.654569:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790100327.654606:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790100327.655211:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad4e0e00 x1877056126220672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100327.655233:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126220672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100327.655908:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126221056:0@lo:400:kworker.0 00000100:00100000:3.0:1790100327.655986:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100327.656018:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100327.656024:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126220928:0@lo:400:kworker.0 00000100:00100000:3.0:1790100327.656046:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100327.656089:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126221056 00000100:00100000:3.0:1790100327.656096:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126221056 00000100:00100000:3.0:1790100327.656147:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126220928 00000100:00100000:3.0:1790100327.656150:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126220928 00000100:00100000:3.0:1790100327.656167:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790100327.656174:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126221056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100327.656219:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126221056:12345-0@lo:400:kworker.0 Request processed in 46us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100327.656225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790100327.656241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790100327.656246:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126220928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100327.656270:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126220928:12345-0@lo:400:kworker.0 Request processed in 24us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100327.656276:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1790100327.656299:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100327.656320:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126220928:0@lo:400:kworker.0 00000100:00100000:3.0:1790100327.656330:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126221056:0@lo:400:kworker.0 00000100:00100000:1.0:1790100327.656446:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126220800:0@lo:400:kworker.0 00000100:00100000:1.0:1790100327.656481:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100327.656518:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126221312:0@lo:400:kworker.0 00000100:00100000:1.0:1790100327.656540:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100327.656559:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100327.656565:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126221184:0@lo:400:kworker.0 00000100:00100000:1.0:1790100327.656597:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100327.656656:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126221312 00000100:00100000:1.0:1790100327.656661:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126221184 00000100:00100000:0.0:1790100327.656662:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126221312 00000100:00100000:1.0:1790100327.656669:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126221184 00000100:00100000:0.0:1790100327.656708:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790100327.656715:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790100327.656718:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126221312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100327.656728:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126221184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100327.656759:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126221312:12345-0@lo:400:kworker.0 Request processed in 43us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100327.656764:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1790100327.656778:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100327.656781:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100327.656807:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126221312:0@lo:400:kworker.0 00000100:00100000:1.0:1790100327.656900:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126221184:12345-0@lo:400:kworker.0 Request processed in 167us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100327.656907:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1790100327.657379:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d678b153800 x1877056126221184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100327.657390:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126221184:0@lo:400:kworker.0 00000100:00100000:3.0:1790100327.657524:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126220800 00000100:00100000:3.0:1790100327.657529:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126220800 00000100:00100000:3.0:1790100327.657702:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790100327.657711:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126220800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100327.657768:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126220800:12345-0@lo:400:kworker.0 Request processed in 59us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100327.657889:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790100327.658170:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126220800:0@lo:400:kworker.0 00010000:00010000:1.0:1790100327.719269:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100328.678064:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126221440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100328.678178:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100328.678479:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126221440 00000100:00100000:2.0:1790100328.678509:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126221440 00000100:00100000:2.0:1790100328.678575:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100328.678588:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126221440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100328.678664:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100328.678727:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126221440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100328.678734:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790100328.678877:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787de8380 x1877056126221440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100328.678899:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126221440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790100328.741821:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100329.006069:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100329.010338:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109417216 00000100:00100000:0.0:1790100329.010364:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109417216 00000100:00100000:0.0:1790100329.010458:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:0.0:1790100329.010472:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:5596:x1877056109417216:12345-192.168.201.18@tcp:101: 00010000:00010000:0.0:1790100329.010518:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100329.010541:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf531c00/0x31a8f3fdeeefcf48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64b3e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100329.010578:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf531c00/0x31a8f3fdeeefcf48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b3e expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100329.010587:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf531c00/0x31a8f3fdeeefcf48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b3e expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100329.010596:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf531c00, rc 0) 00000100:00100000:0.0:1790100329.010732:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5596:x1877056109417216:12345-192.168.201.18@tcp:101: Request processed in 264us (4679us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100329.010740:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:0.0:1790100329.020398:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100329.020664:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109417344 00000100:00100000:2.0:1790100329.020677:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109417344 00000100:00100000:2.0:1790100329.020787:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:2.0:1790100329.020800:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5596:x1877056109417344:12345-192.168.201.18@tcp:501: 00000100:00100000:2.0:1790100329.021239:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5596:x1877056109417344:12345-192.168.201.18@tcp:501: Request processed in 440us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100329.021249:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:3.0:1790100329.029654:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100329.029902:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109417472 00000100:00100000:0.0:1790100329.029916:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109417472 00000100:00100000:0.0:1790100329.030044:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:0.0:1790100329.030058:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5596:x1877056109417472:12345-192.168.201.18@tcp:503: 00000100:00100000:0.0:1790100329.030417:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5596:x1877056109417472:12345-192.168.201.18@tcp:503: Request processed in 361us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100329.030425:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:1.0:1790100329.047035:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100329.048191:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109417600 00000100:00100000:2.0:1790100329.048212:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109417600 00000100:00100000:2.0:1790100329.048298:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:2.0:1790100329.048321:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:6093:x1877056109417600:12345-192.168.201.18@tcp:502: 00000100:00100000:2.0:1790100329.048788:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:6093:x1877056109417600:12345-192.168.201.18@tcp:502: Request processed in 478us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100329.048797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:1.0:1790100329.064745:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100329.064872:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109417728 00000100:00100000:0.0:1790100329.064892:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109417728 00000100:00100000:0.0:1790100329.064978:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:0.0:1790100329.064993:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:6093:x1877056109417728:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100329.065550:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:6093:x1877056109417728:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 558us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100329.065569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:0.0:1790100329.086461:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100329.090316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109417856 00000100:00100000:3.0:1790100329.090338:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109417856 00000100:00100000:2.0:1790100329.092022:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:2.0:1790100329.092050:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5596:x1877056109417856:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100329.092073:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100329.092102:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781657a00/0x31a8f3fdeeefcf4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64b45 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100329.092173:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781657a00/0x31a8f3fdeeefcf4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b45 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100329.092188:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781657a00/0x31a8f3fdeeefcf4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b45 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100329.092199:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781657a00, rc 0) 00000100:00100000:2.0:1790100329.092410:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5596:x1877056109417856:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 364us (5964us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100329.092419:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:1.0:1790100329.099574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100329.099880:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109417984 00000100:00100000:2.0:1790100329.099894:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109417984 00000100:00100000:2.0:1790100329.099964:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:2.0:1790100329.099975:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5596:x1877056109417984:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100329.100509:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5596:x1877056109417984:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 533us (950us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790100329.100518:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 169 00010000:00010000:2.0:1790100329.775235:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790100330.326602:0:8515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb0977fc0 20000000:00000080:0.0:1790100330.326736:0:8515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d67b5d61c00 uarg=0000000000000000 20000000:01000000:0.0:1790100330.326771:0:8515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790100330.326778:0:8515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790100330.326782:0:8515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790100330.327943:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1790100330.328122:0:8515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1790100330.332578:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1790100330.332681:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1790100330.332738:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1790100330.332755:0:8515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790100330.332776:0:8515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.332795:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781522e00/0x31a8f3fdeeefcd1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd18 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.332803:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcd8f expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.332945:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcdf1 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.332955:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b0d expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.332963:0:8515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.333031:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b0d expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.333047:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b0d expref: 9 pid: 5836 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100330.333062:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877056126221568:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100330.333170:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcdf1 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.333178:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdf1 expref: 18 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100330.333243:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877056126221696:0@lo:104: 00000100:00100000:0.0:1790100330.333286:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100330.333336:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126221696 00000100:00100000:0.0:1790100330.333345:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126221696 00000100:00100000:0.0:1790100330.333392:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790100330.333401:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8515:x1877056126221696:12345-0@lo:104: 00010000:00010000:0.0:1790100330.333414:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.333461:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100330.333467:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8515:x1877056126221696:12345-0@lo:104: Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100330.333474:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1790100330.333508:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcd8f expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.333523:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd8f expref: 18 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100330.333532:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877056126221824:0@lo:104: 00000100:00100000:0.0:1790100330.333556:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100330.333579:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790100330.333588:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126221824 00000100:00100000:0.0:1790100330.333592:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126221824 00000100:00100000:0.0:1790100330.333630:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790100330.333637:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8515:x1877056126221824:12345-0@lo:104: 00010000:00010000:0.0:1790100330.333645:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.333680:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790100330.333685:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8515:x1877056126221824:12345-0@lo:104: Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100330.333691:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1790100330.333728:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100330.333734:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.333742:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21ff200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1790100330.333745:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.333754:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100330.333771:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100330.333777:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790100330.333802:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.335400:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100330.335441:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.335451:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff200/0x31a8f3fdeeefcdf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcdf8 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.335467:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100330.335471:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.335477:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780031800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1790100330.335480:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.335489:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100330.335494:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100330.335500:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790100330.335555:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.335561:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100330.335583:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.335590:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcd8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.335601:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100330.335603:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100330.335605:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100330.335957:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100330.335977:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126221952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100330.336048:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100330.336908:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126222080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100330.336950:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100330.337120:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126221952 00000100:00100000:2.0:1790100330.337129:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126221952 00010000:00010000:2.0:1790100330.337164:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdf1 expref: 19 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100330.337222:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126222080 00000100:00100000:2.0:1790100330.337227:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126222080 00010000:00010000:2.0:1790100330.337245:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd8f expref: 20 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100330.337259:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100330.337266:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+20:3313:x1877056126221952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100330.337279:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100330.337284:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdf1 expref: 20 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.337294:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdf1 expref: 20 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.337312:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100330.337349:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+20:3313:x1877056126221952:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100330.337357:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790100330.337373:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100330.337378:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126222080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100330.337385:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100330.337390:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd8f expref: 19 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.337397:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd8f expref: 19 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.337406:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100330.337436:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126222080:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100330.337442:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790100330.337473:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126221952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100330.337706:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126222080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100330.337735:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781522e00/0x31a8f3fdeeefcd1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcd18 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.337747:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6781522e00/0x31a8f3fdeeefcd1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd18 expref: 18 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100330.337759:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877056126222208:0@lo:104: 00000100:00100000:0.0:1790100330.337785:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100330.337819:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e2540 going to sleep for 11 seconds 00010000:00010000:0.0:1790100330.337832:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcdf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcdf1 expref: 18 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100330.337844:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e40a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877056126221696:0@lo:104: 00010000:00010000:0.0:1790100330.337853:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcd96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd8f expref: 17 pid: 5836 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100330.337869:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877056126221824:0@lo:104: 00000100:00100000:1.0:1790100330.337999:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126222208 00000100:00100000:1.0:1790100330.338015:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126222208 00000100:00100000:1.0:1790100330.338037:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790100330.338043:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8515:x1877056126222208:12345-0@lo:104: 00010000:00010000:1.0:1790100330.338055:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.338107:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100330.338113:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+3:8515:x1877056126222208:12345-0@lo:104: Request processed in 70us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100330.338118:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790100330.338135:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100330.338141:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.338149:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21ffa00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100330.338152:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.338160:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100330.338167:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100330.338180:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790100330.338213:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.338220:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100330.338244:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.338252:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67c21ffa00/0x31a8f3fdeeefcd18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcd1f expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.338268:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100330.338270:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100330.338271:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100330.338284:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126222336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100330.338308:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790100330.338335:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100330.338343:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126222336 00000100:00100000:1.0:1790100330.338346:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126222336 00010000:00010000:1.0:1790100330.338360:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781522e00/0x31a8f3fdeeefcd1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd18 expref: 17 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100330.338377:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790100330.338383:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3312:x1877056126222336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100330.338391:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100330.338396:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781522e00/0x31a8f3fdeeefcd1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd18 expref: 17 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.338414:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781522e00/0x31a8f3fdeeefcd1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd18 expref: 17 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.338425:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100330.338451:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3312:x1877056126222336:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100330.338458:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790100330.338482:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126222336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100330.338972:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781522e00/0x31a8f3fdeeefcd1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcd18 expref: 16 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100330.338983:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877056126222208:0@lo:104: 00000100:00100000:1.0:1790100330.339492:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100330.339770:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109418112 00000100:00100000:2.0:1790100330.339777:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109418112 00010000:00010000:2.0:1790100330.339803:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b0d expref: 10 pid: 5836 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100330.339848:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:2.0:1790100330.339857:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2358:x1877056109418112:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100330.339869:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100330.339873:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b0d expref: 10 pid: 5836 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339883:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b0d expref: 10 pid: 5836 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339898:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339906:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339923:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339929:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339948:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339955:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339961:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf530000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100330.339965:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339973:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339982:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100330.339991:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100330.340053:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2358:x1877056109418112:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 196us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100330.340061:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00010000:00010000:0.0:1790100330.340392:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781523600/0x31a8f3fdeeefceb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b0d expref: 9 pid: 5836 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100330.340404:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1877056126221568:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100330.340434:0:8515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.340716:0:8515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.340725:0:8515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100330.340731:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf530000/0x31a8f3fdeeefcf56 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100330.440825:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100330.441046:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109418240 00000100:00100000:0.0:1790100330.441057:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109418240 00000100:00100000:0.0:1790100330.441128:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:0.0:1790100330.441139:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:5596:x1877056109418240:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100330.441158:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100330.441178:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64b4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.441205:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b4c expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.441217:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b4c expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100330.441227:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530e00, rc 0) 00000100:00100000:0.0:1790100330.441292:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5596:x1877056109418240:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 154us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100330.441299:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:2.0:1790100330.455451:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100330.455527:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109418368 00000100:00100000:3.0:1790100330.455538:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109418368 00000100:00100000:3.0:1790100330.455593:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:3.0:1790100330.455604:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5596:x1877056109418368:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100330.455929:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5596:x1877056109418368:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 325us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100330.455937:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:0.0:1790100330.460714:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100330.460759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109418496 00000100:00100000:0.0:1790100330.460770:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109418496 00000100:00100000:0.0:1790100330.460818:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:0.0:1790100330.460829:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5596:x1877056109418496:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100330.461075:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:5596:x1877056109418496:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 246us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100330.461083:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:3.0:1790100330.472159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100330.472391:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109418624 00000100:00100000:1.0:1790100330.472401:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109418624 00000100:00100000:1.0:1790100330.472453:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:1.0:1790100330.472464:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:6125:x1877056109418624:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100330.472733:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:6125:x1877056109418624:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 270us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100330.472753:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:0.0:1790100330.484160:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100330.484302:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109418752 00000100:00100000:2.0:1790100330.484315:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109418752 00000100:00100000:2.0:1790100330.484369:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 174 00000100:00100000:2.0:1790100330.484381:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:6125:x1877056109418752:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790100330.484661:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:6125:x1877056109418752:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 281us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100330.484670:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 174 00010000:00010000:1.0:1790100330.792230:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100331.063864:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100331.063904:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100331.063941:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100331.064013:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109419008 00000100:00100000:2.0:1790100331.064026:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109419008 00000100:00100000:2.0:1790100331.064102:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109419136 00000100:00100000:2.0:1790100331.064106:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109419136 00000100:00100000:2.0:1790100331.064128:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:2.0:1790100331.064141:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109419008:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100331.064238:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109419008:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 100us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100331.064246:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:2.0:1790100331.064266:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1790100331.064273:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109419136:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100331.064300:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109419136:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100331.064307:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00080000:2.0:1790100331.064325:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100331.064329:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100331.064598:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109418880 00000100:00100000:3.0:1790100331.064603:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109418880 00000100:00100000:3.0:1790100331.064683:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:3.0:1790100331.064767:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109418880:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100331.064822:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109418880:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 131us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100331.064830:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00080000:2.0:1790100331.065363:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790100331.814093:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790100332.262161:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100332.262172:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6787677800 from 4 10000000:01000000:0.0:1790100332.262178:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100332.262457:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100332.262473:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100332.262486:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100332.262521:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126222464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100332.262647:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100332.262714:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790100332.262850:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126222464 00000100:00100000:3.0:1790100332.262859:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126222464 00000100:00100000:3.0:1790100332.262930:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1790100332.262942:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126222464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100332.262960:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100332.262985:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcf64 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100332.263014:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf64 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100332.263060:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf64 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100332.263071:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae000, rc 0) 00000100:00100000:3.0:1790100332.263140:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126222464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100332.263148:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1790100332.263176:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126222464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100332.263192:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.263203:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100332.263278:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126222592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.263307:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.263333:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100332.263443:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126222592 00000100:00100000:0.0:1790100332.263453:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126222592 00000100:00100000:0.0:1790100332.263479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790100332.263483:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126222592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100332.263754:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126222592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100332.263761:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1790100332.263862:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126222592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.263886:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126222720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.263917:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.263941:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c180 going to sleep for 11 seconds 00000100:00100000:3.0:1790100332.263962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126222720 00000100:00100000:3.0:1790100332.263967:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126222720 00000100:00100000:3.0:1790100332.264010:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790100332.264017:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126222720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100332.264350:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126222720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 333us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100332.264357:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1790100332.264855:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126222720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100332.265498:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8594:1877056126222848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100332.265563:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100332.265640:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126222848 00000100:00100000:3.0:1790100332.265646:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126222848 00000100:00100000:2.0:1790100332.265647:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bb532300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100332.265690:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790100332.265700:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:8594:x1877056126222848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100332.265931:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:8594:x1877056126222848:12345-0@lo:502:llog_process_th.0 Request processed in 231us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100332.265938:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790100332.266020:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8594:1877056126222848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100332.266047:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100332.266060:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100332.266071:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790100332.266083:0:8594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6787677800 00000020:00000080:2.0:1790100332.266087:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790100332.266179:0:8594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8594:1877056126222976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100332.266287:0:8594:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100332.266318:0:8594:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bb532300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100332.266377:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126222976 00000100:00100000:0.0:1790100332.266381:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126222976 00000100:00100000:0.0:1790100332.266416:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790100332.266424:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:8594:x1877056126222976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100332.266562:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:8594:x1877056126222976:12345-0@lo:502:llog_process_th.0 Request processed in 139us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100332.266567:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790100332.266665:0:8594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8594:1877056126222976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100332.266680:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100332.266685:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100332.266686:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790100332.266692:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790100332.266889:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790100332.266917:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100332.266929:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.266939:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100332.266949:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100332.266952:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67ad888800 from 4 10000000:01000000:1.0:1790100332.266954:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100332.266991:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.267013:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.267023:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100332.267039:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.267074:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.267110:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c180 going to sleep for 11 seconds 00000100:00100000:2.0:1790100332.267160:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126223104 00000100:00100000:2.0:1790100332.267164:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126223104 00000100:00100000:2.0:1790100332.267200:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790100332.267319:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126223104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100332.267330:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100332.267347:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcf72 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100332.267374:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf72 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100332.267385:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf72 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100332.267395:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781657800, rc 0) 00000100:00100000:2.0:1790100332.267934:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126223104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 724us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100332.267942:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790100332.270717:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100332.270758:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.270774:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100332.270883:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.270967:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.271047:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100332.271168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126223232 00000100:00100000:0.0:1790100332.271177:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126223232 00000100:00100000:0.0:1790100332.271296:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790100332.271311:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126223232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100332.271825:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126223232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 516us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100332.271836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1790100332.272241:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100332.272312:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100332.272412:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100332.272692:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2633300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100332.272863:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126223360 00000100:00100000:0.0:1790100332.272873:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126223360 00000100:00100000:0.0:1790100332.272937:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790100332.272956:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126223360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100332.273730:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126223360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 777us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100332.273748:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790100332.273947:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.278774:0:8596:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8596:1877056126223488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100332.278855:0:8596:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.278900:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126223488 00000100:00100000:1.0:1790100332.278908:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126223488 00000100:00100000:1.0:1790100332.278955:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790100332.278965:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8596:x1877056126223488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100332.279215:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8596:x1877056126223488:12345-0@lo:502:llog_process_th.0 Request processed in 250us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100332.279223:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790100332.279281:0:8596:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100332.279304:0:8596:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8596:1877056126223488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100332.279332:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100332.279342:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100332.279345:0:8596:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790100332.279351:0:8596:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67ad888800 00000020:00000080:1.0:1790100332.279354:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790100332.279430:0:8596:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8596:1877056126223616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100332.279467:0:8596:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.279489:0:8596:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100332.279492:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126223616 00000100:00100000:0.0:1790100332.279496:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126223616 00000100:00100000:0.0:1790100332.279518:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1790100332.279524:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8596:x1877056126223616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100332.279640:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:8596:x1877056126223616:12345-0@lo:502:llog_process_th.0 Request processed in 117us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100332.279645:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790100332.280695:0:8596:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8596:1877056126223616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790100332.280724:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100332.280731:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100332.280733:0:8596:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790100332.280737:0:8596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790100332.281061:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790100332.281082:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100332.281095:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100332.281108:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100332.281121:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790100332.281125:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6788844800 from 4 10000000:01000000:3.0:1790100332.281128:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100332.281162:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100332.281170:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100332.281181:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100332.281201:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787dea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100332.281328:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100332.281598:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2633180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100332.283957:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126223744 00000100:00100000:1.0:1790100332.283982:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126223744 00000100:00100000:1.0:1790100332.284046:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790100332.284056:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126223744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100332.284074:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100332.284094:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcf80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.284124:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf80 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.284145:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf80 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.284157:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780030600, rc 0) 00000100:00100000:1.0:1790100332.284238:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126223744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100332.284245:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790100332.284317:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787dea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100332.284338:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.284349:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100332.284421:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.284458:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.284493:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100332.284509:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126223872 00000100:00100000:1.0:1790100332.284513:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126223872 00000100:00100000:1.0:1790100332.285712:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790100332.285726:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126223872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.286024:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126223872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100332.286032:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790100332.286080:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126223872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.286134:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126224000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.286174:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.286201:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100332.286215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126224000 00000100:00100000:1.0:1790100332.286220:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126224000 00000100:00100000:1.0:1790100332.286244:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790100332.286250:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126224000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.286389:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126224000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100332.286396:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790100332.286430:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126224000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100332.287733:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8599:1877056126224128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100332.287793:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.287882:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126224128 00000100:00100000:1.0:1790100332.287889:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126224128 00000100:00100000:1.0:1790100332.287969:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790100332.287989:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:8599:x1877056126224128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100332.288156:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:8599:x1877056126224128:12345-0@lo:502:llog_process_th.0 Request processed in 168us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100332.288164:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1790100332.296724:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100332.296769:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8599:1877056126224128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100332.296811:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100332.296823:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100332.296825:0:8599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790100332.296833:0:8599:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6788844800 00000020:00000080:0.0:1790100332.296838:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790100332.297197:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8599:1877056126224256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100332.297267:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100332.297302:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100332.299588:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126224256 00000100:00100000:1.0:1790100332.299606:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126224256 00000100:00100000:1.0:1790100332.299837:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1790100332.299848:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:8599:x1877056126224256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100332.300171:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:8599:x1877056126224256:12345-0@lo:502:llog_process_th.0 Request processed in 324us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100332.300185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1790100332.305654:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:8599:1877056126224256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100332.305698:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100332.305706:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100332.305708:0:8599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790100332.305713:0:8599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790100332.306958:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790100332.306997:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100332.307010:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100332.307024:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100332.774078:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126224384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100332.774157:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100332.774549:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126224384 00000100:00100000:2.0:1790100332.774558:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126224384 00000100:00100000:2.0:1790100332.774654:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100332.774666:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126224384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100332.774703:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100332.774753:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126224384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100332.774761:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790100332.774802:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad4e0700 x1877056126224384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100332.774820:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126224384:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790100332.775094:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100332.775858:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126224768:0@lo:400:kworker.0 00000100:00100000:1.0:1790100332.775904:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.775934:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100332.775941:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126224640:0@lo:400:kworker.0 00000100:00100000:1.0:1790100332.775979:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100332.776009:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126224768 00000100:00100000:1.0:1790100332.776015:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126224768 00000100:00100000:1.0:1790100332.776053:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126224640 00000100:00100000:1.0:1790100332.776055:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126224640 00000100:00100000:1.0:1790100332.776071:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790100332.776078:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126224768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100332.776119:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126224768:12345-0@lo:400:kworker.0 Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100332.776126:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790100332.776138:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790100332.776143:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126224640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100332.776164:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126224640:12345-0@lo:400:kworker.0 Request processed in 21us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100332.776177:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1790100332.776211:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100332.776234:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126224640:0@lo:400:kworker.0 00000100:00100000:1.0:1790100332.776242:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126224768:0@lo:400:kworker.0 00000100:00100000:3.0:1790100332.776483:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126224512:0@lo:400:kworker.0 00000100:00100000:3.0:1790100332.776518:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100332.776559:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126225024:0@lo:400:kworker.0 00000100:00100000:3.0:1790100332.776580:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100332.776607:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100332.776632:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126224896:0@lo:400:kworker.0 00000100:00100000:3.0:1790100332.776665:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100332.776787:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126225024 00000100:00100000:0.0:1790100332.776793:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126225024 00000100:00100000:0.0:1790100332.776834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790100332.776842:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126225024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100332.776884:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126225024:12345-0@lo:400:kworker.0 Request processed in 43us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100332.776889:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790100332.776915:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126225024:0@lo:400:kworker.0 00000100:00080000:3.0:1790100332.776983:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100332.777080:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126224896 00000100:00100000:2.0:1790100332.777085:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126224896 00000100:00100000:2.0:1790100332.777140:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100332.777147:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126224896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100332.777188:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126224896:12345-0@lo:400:kworker.0 Request processed in 43us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100332.777194:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790100332.777322:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67852cd500 x1877056126224896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100332.777332:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126224896:0@lo:400:kworker.0 00000100:00100000:1.0:1790100332.777431:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126224512 00000100:00100000:1.0:1790100332.777435:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126224512 00000100:00100000:1.0:1790100332.777470:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1790100332.777478:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126224512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100332.777524:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126224512:12345-0@lo:400:kworker.0 Request processed in 47us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100332.777530:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1790100332.777646:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100332.777924:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126224512:0@lo:400:kworker.0 00010000:00010000:1.0:1790100332.837800:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100333.797851:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126225152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100333.797928:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100333.798063:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126225152 00000100:00100000:3.0:1790100333.798072:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126225152 00000100:00100000:3.0:1790100333.798125:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790100333.798134:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126225152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100333.798170:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100333.798228:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126225152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100333.798235:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790100333.798383:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787de9c00 x1877056126225152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100333.798413:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126225152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790100333.867363:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100334.887824:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100335.916785:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100336.181942:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100336.181973:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100336.182000:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100336.182024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100336.182058:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109419648 00000100:00100000:0.0:1790100336.182071:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109419648 00000100:00100000:1.0:1790100336.182244:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109419392 00000100:00100000:1.0:1790100336.182248:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109419392 00000100:00100000:1.0:1790100336.182283:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:1.0:1790100336.182294:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2359:x1877056109419392:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100336.182367:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2359:x1877056109419392:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 75us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100336.182375:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:1.0:1790100336.182397:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109419520 00000100:00100000:1.0:1790100336.182402:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109419520 00000100:00100000:1.0:1790100336.182420:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:1.0:1790100336.182427:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109419648:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100336.182470:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109419648:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 44us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100336.182477:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:1.0:1790100336.182489:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:1.0:1790100336.182495:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109419520:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100336.182517:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109419520:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 22us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100336.182523:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:1.0:1790100336.182540:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109419264 00000100:00100000:1.0:1790100336.182542:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109419264 00000100:00100000:1.0:1790100336.182566:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00100000:1.0:1790100336.182572:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2359:x1877056109419264:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100336.182597:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2359:x1877056109419264:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100336.182603:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00080000:0.0:1790100336.183860:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100336.183867:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100336.183870:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1790100336.319809:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1790100336.934281:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100337.894244:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126225408:0@lo:400:kworker.0 00000100:00100000:1.0:1790100337.894322:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100337.894390:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126225920:0@lo:400:kworker.0 00000100:00100000:1.0:1790100337.894416:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100337.894448:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100337.894454:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126225536:0@lo:400:kworker.0 00000100:00100000:1.0:1790100337.894475:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100337.894505:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126225920 00000100:00100000:1.0:1790100337.894514:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126225920 00000100:00100000:1.0:1790100337.894586:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100337.894596:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126225920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100337.894670:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126225920:12345-0@lo:400:kworker.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100337.894677:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100337.894701:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126225408 00000100:00100000:1.0:1790100337.894705:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126225408 00000100:00100000:1.0:1790100337.894726:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126225536 00000100:00100000:1.0:1790100337.894729:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126225536 00000100:00100000:1.0:1790100337.894748:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100337.894755:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126225408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100337.894785:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126225408:12345-0@lo:400:kworker.0 Request processed in 31us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100337.894791:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100337.894802:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790100337.894808:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126225536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100337.894833:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126225536:12345-0@lo:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100337.894838:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790100337.894890:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126225536:0@lo:400:kworker.0 00000100:00100000:1.0:1790100337.894902:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126225408:0@lo:400:kworker.0 00010000:00080000:1.0:1790100337.894914:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787de9500 x1877056126225920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100337.894923:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126225920:0@lo:400:kworker.0 00000100:00100000:0.0:1790100337.895440:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126225664:0@lo:400:kworker.0 00000100:00100000:0.0:1790100337.895480:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100337.895515:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790100337.895522:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126225280:0@lo:400:kworker.0 00000100:00100000:0.0:1790100337.895548:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100337.895578:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126225792:0@lo:400:kworker.0 00000100:00100000:0.0:1790100337.895599:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790100337.895651:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100337.895656:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100337.895666:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126225664 00000100:00100000:0.0:1790100337.895672:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126225664 00000100:00100000:0.0:1790100337.895708:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790100337.895715:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126225664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100337.895757:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126225664:12345-0@lo:400:kworker.0 Request processed in 42us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100337.895762:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1790100337.895777:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100337.895784:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126225792 00000100:00100000:0.0:1790100337.895787:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126225792 00000100:00100000:0.0:1790100337.895812:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790100337.895817:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126225792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100337.895845:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126225792:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100337.895850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1790100337.895866:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100337.895897:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126225792:0@lo:400:kworker.0 00010000:00080000:0.0:1790100337.895909:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787deb800 x1877056126225664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100337.895930:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126225664:0@lo:400:kworker.0 00000100:00100000:3.0:1790100337.896003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126225280 00000100:00100000:3.0:1790100337.896008:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126225280 00000100:00100000:3.0:1790100337.896054:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790100337.896060:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126225280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100337.896102:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126225280:12345-0@lo:400:kworker.0 Request processed in 42us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100337.896107:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1790100337.896149:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126225280:0@lo:400:kworker.0 00000100:00100000:1.0:1790100337.897579:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100337.897631:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126226048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100337.897686:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100337.897771:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126226048 00000100:00100000:3.0:1790100337.897779:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126226048 00000100:00100000:3.0:1790100337.897818:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790100337.897826:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126226048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100337.897861:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100337.897923:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126226048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100337.897936:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1790100337.898246:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787deb100 x1877056126226048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100337.898265:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126226048:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790100337.961258:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100338.917922:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100338.917946:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126226176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100338.918020:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100338.918137:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126226176 00000100:00100000:3.0:1790100338.918148:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126226176 00000100:00100000:3.0:1790100338.918213:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790100338.918223:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126226176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100338.918263:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100338.918310:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126226176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100338.918317:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1790100338.918409:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787de9180 x1877056126226176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100338.918428:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126226176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100338.989781:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100340.005822:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100341.029834:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790100341.149309:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing yml_node 00000100:00100000:0.0:1790100341.301850:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100341.301890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100341.301918:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109419776 00000100:00100000:0.0:1790100341.301928:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109419776 00000100:00100000:0.0:1790100341.301983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:0.0:1790100341.301993:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2358:x1877056109419776:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100341.302704:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2358:x1877056109419776:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 708us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100341.302713:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:0.0:1790100341.302753:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109419904 00000100:00100000:0.0:1790100341.302758:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109419904 00000100:00100000:0.0:1790100341.303955:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:0.0:1790100341.303969:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109419904:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100341.304033:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109419904:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 68us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100341.304040:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00080000:0.0:1790100341.304655:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100341.307899:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100341.307936:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100341.308129:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109420032 00000100:00100000:0.0:1790100341.308141:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109420032 00000100:00100000:0.0:1790100341.308206:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109420160 00000100:00100000:0.0:1790100341.308210:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109420160 00000100:00100000:0.0:1790100341.308230:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:0.0:1790100341.308238:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2356:x1877056109420032:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:0.0:1790100341.308274:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcec3 00000100:00080000:0.0:1790100341.308291:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d67bf9a9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790100341.308328:0:6687:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790100341.308776:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+2:2356:x1877056109420032:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 536us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100341.308783:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:0.0:1790100341.308800:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1790100341.308806:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2356:x1877056109420160:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:0.0:1790100341.308830:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefceca 00000100:00080000:0.0:1790100341.308837:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d67bf9ad800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790100341.308859:0:6687:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790100341.309045:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+2:2356:x1877056109420160:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 238us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100341.309066:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00010000:00010000:0.0:1790100341.309134:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100341.309240:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100341.310270:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100341.310276:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790100342.057772:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790100342.073445:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:2.0:1790100342.073455:0:6714:0:(genops.c:885:class_export_put()) final put ffff8d67bf9a8000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:3.0:1790100342.077403:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf9a8000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c for lustre-OST0000 00000020:00000080:2.0:1790100342.077658:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67bf9a9800 for lustre-OST0000 00000100:00100000:1.0:1790100343.014752:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126226304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100343.014850:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100343.015312:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100343.015337:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126226688:0@lo:400:kworker.0 00000100:00100000:2.0:1790100343.015386:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100343.015440:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126226816:0@lo:400:kworker.0 00000100:00100000:2.0:1790100343.015473:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100343.015660:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126226560:0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.015692:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100343.015723:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790100343.015729:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126226432:0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.015764:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100343.015807:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126226944:0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.015833:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100343.015861:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126226688 00000100:00100000:0.0:1790100343.015870:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126226688 00000100:00100000:0.0:1790100343.015919:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126226560 00000100:00100000:0.0:1790100343.015935:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126226560 00000100:00100000:0.0:1790100343.015958:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126226944 00000100:00100000:0.0:1790100343.015961:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126226944 00000100:00100000:0.0:1790100343.015977:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790100343.015984:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126226688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.016036:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126226688:12345-0@lo:400:kworker.0 Request processed in 51us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100343.016043:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790100343.016074:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790100343.016080:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126226560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.016112:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126226560:12345-0@lo:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100343.016119:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790100343.016130:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790100343.016136:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126226944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.016163:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126226944:12345-0@lo:400:kworker.0 Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100343.016169:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790100343.016189:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126226816 00000100:00100000:0.0:1790100343.016193:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126226816 00000100:00100000:0.0:1790100343.016221:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790100343.016228:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126226816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.016259:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126226816:12345-0@lo:400:kworker.0 Request processed in 32us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100343.016264:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790100343.016282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126226432 00000100:00100000:0.0:1790100343.016285:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126226432 00000100:00100000:0.0:1790100343.016304:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790100343.016318:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126226432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.016347:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126226432:12345-0@lo:400:kworker.0 Request processed in 32us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100343.016353:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1790100343.016416:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126226432:0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.016430:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126226944:0@lo:400:kworker.0 00000100:00100000:0.0:1790100343.016438:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126226560:0@lo:400:kworker.0 00000100:00100000:3.0:1790100343.016738:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126226304 00000100:00100000:3.0:1790100343.016743:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126226304 00000100:00100000:3.0:1790100343.016783:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790100343.016801:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126226304:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790100343.016956:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790100343.016960:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100343.016963:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:3.0:1790100343.017087:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100343.017133:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126226304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 343us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100343.017139:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1790100343.017361:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad4e1880 x1877056126226816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100343.017372:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126226816:0@lo:400:kworker.0 00000100:00100000:2.0:1790100343.017384:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126226688:0@lo:400:kworker.0 00010000:00080000:2.0:1790100343.017393:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787dea680 x1877056126226304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100343.017406:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126226304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790100343.077945:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100344.039825:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126227072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100344.039930:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100344.040262:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126227072 00000100:00100000:3.0:1790100344.040273:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126227072 00000100:00100000:3.0:1790100344.040340:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790100344.040364:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126227072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100344.040416:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100344.040472:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126227072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100344.040481:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1790100344.040888:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787de9f80 x1877056126227072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100344.040914:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126227072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100344.101894:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790100344.644395:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.63 00010000:00010000:3.0:1790100345.133999:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790100345.616190:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:1.0:1790100345.616207:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d67bf9ae800/dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:2.0:1790100345.616290:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf9ae800/dd2cd87b-6ca1-4323-9b74-fad785d94e6c for lustre-OST0001 00000020:00000080:2.0:1790100345.616360:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67bf9ad800 for lustre-OST0001 00010000:00010000:0.0:1790100346.152352:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100346.416316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100346.416364:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100346.416812:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109420416 00000100:00100000:0.0:1790100346.416824:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109420416 00000100:00100000:0.0:1790100346.416898:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:0.0:1790100346.416909:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109420416:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100346.417003:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109420416:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 95us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100346.417011:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:1.0:1790100346.418356:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109420288 00000100:00100000:1.0:1790100346.418366:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109420288 00000100:00100000:1.0:1790100346.418415:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:1.0:1790100346.418425:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109420288:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100346.418485:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109420288:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 61us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100346.418492:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00080000:1.0:1790100346.418537:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1790100346.676251:0:9348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.63 00010000:00010000:3.0:1790100347.176819:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100348.133858:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100348.133883:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126227200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100348.133954:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100348.134108:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126227200 00000100:00100000:3.0:1790100348.134117:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126227200 00000100:00100000:3.0:1790100348.134173:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790100348.134181:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126227200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100348.134213:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100348.134254:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126227200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100348.134261:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790100348.134263:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126227584:0@lo:400:kworker.0 00000100:00100000:3.0:1790100348.134295:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126227328:0@lo:400:kworker.0 00000100:00100000:0.0:1790100348.134324:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100348.134329:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100348.134359:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126227840:0@lo:400:kworker.0 00000100:00100000:0.0:1790100348.134366:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100348.134379:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126227456:0@lo:400:kworker.0 00000100:00100000:3.0:1790100348.134386:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790100348.134425:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787deb480 x1877056126227200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100348.134426:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100348.134448:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126227200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100348.134465:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126227584 00000100:00100000:3.0:1790100348.134471:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100348.134471:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126227584 00000100:00100000:3.0:1790100348.134480:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126227712:0@lo:400:kworker.0 00000100:00100000:0.0:1790100348.134505:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126227840 00000100:00100000:3.0:1790100348.134509:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100348.134511:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126227840 00000100:00100000:0.0:1790100348.134531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126227456 00000100:00100000:0.0:1790100348.134534:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126227456 00000100:00100000:0.0:1790100348.134553:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790100348.134559:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126227584:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790100348.134595:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790100348.134600:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100348.134605:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126227584:12345-0@lo:400:kworker.0 Request processed in 43us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100348.134734:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100348.134743:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126227840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100348.134789:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126227840:12345-0@lo:400:kworker.0 Request processed in 48us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100348.134796:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790100348.134811:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790100348.134817:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126227456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100348.134844:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126227456:12345-0@lo:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100348.134850:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790100348.134890:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126227712 00000100:00100000:3.0:1790100348.134894:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126227712 00000100:00100000:3.0:1790100348.134927:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790100348.134933:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126227712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100348.134962:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126227712:12345-0@lo:400:kworker.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100348.134968:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790100348.134984:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126227328 00000100:00100000:3.0:1790100348.134988:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126227328 00000100:00100000:3.0:1790100348.135009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1790100348.135015:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126227328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100348.135043:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126227328:12345-0@lo:400:kworker.0 Request processed in 28us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100348.135049:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1790100348.135118:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126227456:0@lo:400:kworker.0 00000100:00100000:3.0:1790100348.135130:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126227584:0@lo:400:kworker.0 00010000:00080000:2.0:1790100348.135788:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5edc00 x1877056126227712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100348.135800:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126227712:0@lo:400:kworker.0 00000100:00100000:2.0:1790100348.135809:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126227328:0@lo:400:kworker.0 00000100:00100000:2.0:1790100348.135824:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126227840:0@lo:400:kworker.0 00000100:00100000:0.0:1790100348.141237:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1790100348.141296:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790100348.201567:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790100348.545125:0:9445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.63 00000100:00100000:3.0:1790100349.158830:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100349.158852:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126227968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100349.158913:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100349.158982:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126227968 00000100:00100000:3.0:1790100349.158991:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126227968 00000100:00100000:3.0:1790100349.159030:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790100349.159038:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126227968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100349.159074:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100349.159113:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126227968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100349.159120:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790100349.159158:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787dea680 x1877056126227968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100349.159175:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126227968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100349.222824:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790100349.630893:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 22 14:05:48 EDT 2026 00010000:00010000:3.0:1790100350.251275:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100351.270988:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100351.532914:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100351.532960:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100351.533001:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109420544 00000100:00100000:3.0:1790100351.533013:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109420544 00000100:00100000:3.0:1790100351.533066:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:3.0:1790100351.533076:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2357:x1877056109420544:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100351.533158:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2357:x1877056109420544:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 84us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100351.533167:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:0.0:1790100351.533357:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109420672 00000100:00100000:0.0:1790100351.533362:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109420672 00000100:00100000:0.0:1790100351.533413:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1790100351.533420:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109420672:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100351.533462:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109420672:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 42us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100351.533469:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00080000:3.0:1790100351.533594:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790100352.294145:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100353.256813:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126228096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100353.256912:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100353.257003:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126228096 00000100:00100000:3.0:1790100353.257025:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126228096 00000100:00100000:3.0:1790100353.257085:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790100353.257095:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126228096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100353.257140:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100353.257184:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126228096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100353.257191:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1790100353.257212:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790100353.257242:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787deb100 x1877056126228096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100353.257262:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126228096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100353.257516:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126228352:0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.257559:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100353.257587:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790100353.257595:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126228224:0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.257662:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100353.257693:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae66a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126228736:0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.257725:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100353.257761:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126228480:0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.257784:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100353.257803:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100353.257808:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126228608:0@lo:400:kworker.0 00000100:00100000:2.0:1790100353.257832:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126228352 00000100:00100000:1.0:1790100353.257835:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100353.257841:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126228352 00000100:00100000:1.0:1790100353.257874:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126228736 00000100:00100000:1.0:1790100353.257879:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126228736 00000100:00100000:2.0:1790100353.257891:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126228480 00000100:00100000:2.0:1790100353.257897:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126228480 00000100:00100000:1.0:1790100353.257919:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790100353.257931:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126228352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100353.257936:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790100353.257947:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126228736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.257988:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126228352:12345-0@lo:400:kworker.0 Request processed in 61us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100353.257997:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790100353.258018:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126228736:12345-0@lo:400:kworker.0 Request processed in 72us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100353.258027:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790100353.258042:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100353.258048:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126228480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100353.258082:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126228480:12345-0@lo:400:kworker.0 Request processed in 34us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100353.258088:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790100353.258190:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126228224 00000100:00100000:1.0:1790100353.258195:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126228224 00000100:00100000:1.0:1790100353.258240:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790100353.258249:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126228224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.258284:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126228224:12345-0@lo:400:kworker.0 Request processed in 37us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100353.258297:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790100353.258427:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126228608 00000100:00100000:1.0:1790100353.258431:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126228608 00000100:00100000:1.0:1790100353.258473:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790100353.258481:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126228608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.258514:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126228608:12345-0@lo:400:kworker.0 Request processed in 35us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100353.258520:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1790100353.258537:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100353.258542:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790100353.258568:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae668000 x1877056126228608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100353.258581:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126228608:0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.258592:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126228480:0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.258662:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126228224:0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.258674:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae66a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126228736:0@lo:400:kworker.0 00000100:00100000:1.0:1790100353.258685:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126228352:0@lo:400:kworker.0 00010000:00010000:0.0:1790100353.318698:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100354.283000:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100354.283123:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae66a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126228864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100354.283200:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100354.286525:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126228864 00000100:00100000:0.0:1790100354.286546:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126228864 00000100:00100000:0.0:1790100354.287437:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790100354.287452:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126228864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100354.287497:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100354.287606:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126228864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (4397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100354.287637:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1790100354.293482:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae66a300 x1877056126228864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100354.293508:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae66a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126228864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100354.342858:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100355.375031:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100356.390037:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100356.653547:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100356.653663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100356.653708:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109420928 00000100:00100000:2.0:1790100356.653721:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109420928 00000100:00100000:0.0:1790100356.653784:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109420800 00000100:00100000:0.0:1790100356.653799:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109420800 00000100:00100000:2.0:1790100356.653820:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:2.0:1790100356.653834:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109420928:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100356.653846:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:0.0:1790100356.653857:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109420800:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:1.0:1790100356.654000:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100356.654100:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109420928:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 269us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100356.654108:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:1.0:1790100356.655047:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109420800:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 1187us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100356.655059:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 199 00010000:00010000:3.0:1790100357.416389:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100358.375604:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126229120:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.375725:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100358.375806:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126229632:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.376008:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100358.376046:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790100358.376053:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126228992:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.376085:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100358.376108:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae66b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126229504:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.376130:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100358.376160:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126229248:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.376185:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100358.376206:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100358.376212:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126229376:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.376235:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100358.376269:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126229120 00000100:00100000:1.0:1790100358.376280:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126229120 00000100:00100000:1.0:1790100358.376333:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126229504 00000100:00100000:1.0:1790100358.376337:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126229504 00000100:00100000:1.0:1790100358.376360:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126229248 00000100:00100000:1.0:1790100358.376362:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126229248 00000100:00100000:1.0:1790100358.376379:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790100358.376388:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126229120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.376451:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126229120:12345-0@lo:400:kworker.0 Request processed in 63us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100358.376459:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790100358.376477:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790100358.376483:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126229504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.376511:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126229504:12345-0@lo:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100358.376540:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790100358.376552:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790100358.376558:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126229248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.376589:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126229248:12345-0@lo:400:kworker.0 Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100358.376595:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790100358.376643:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126229632 00000100:00100000:1.0:1790100358.376646:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126229632 00000100:00100000:0.0:1790100358.377677:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126229376 00000100:00100000:0.0:1790100358.377685:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126229376 00000100:00100000:0.0:1790100358.377738:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790100358.377747:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126229376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100358.377979:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126229376:12345-0@lo:400:kworker.0 Request processed in 232us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100358.377986:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790100358.378022:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126228992 00000100:00100000:0.0:1790100358.378027:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126228992 00000100:00100000:0.0:1790100358.378053:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1790100358.378068:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126228992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100358.378100:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126228992:12345-0@lo:400:kworker.0 Request processed in 33us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100358.378106:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1790100358.378236:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790100358.378244:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126229632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.378279:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae669180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126229632:12345-0@lo:400:kworker.0 Request processed in 36us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100358.378284:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1790100358.383647:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790100358.384102:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100358.384107:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100358.384128:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100358.384161:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126229760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100358.384259:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790100358.384353:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae66bb80 x1877056126229376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100358.384371:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae66bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126229376:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.384386:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126229248:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.384420:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126228992:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.384432:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae66b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126229504:0@lo:400:kworker.0 00000100:00100000:1.0:1790100358.384458:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126229120:0@lo:400:kworker.0 00010000:00080000:1.0:1790100358.384469:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae669880 x1877056126229632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100358.384478:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126229632:0@lo:400:kworker.0 00000100:00100000:2.0:1790100358.384560:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126229760 00000100:00100000:2.0:1790100358.384568:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126229760 00000100:00100000:2.0:1790100358.384670:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790100358.384682:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126229760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100358.384743:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100358.384811:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126229760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100358.384828:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1790100358.385119:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787de9500 x1877056126229760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100358.385140:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126229760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790100358.438182:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100359.398841:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126229888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100359.398916:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100359.399246:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126229888 00000100:00100000:0.0:1790100359.399255:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126229888 00000100:00100000:0.0:1790100359.399340:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100359.399351:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126229888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100359.399391:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100359.399448:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126229888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100359.399456:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1790100359.399543:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5e9f80 x1877056126229888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100359.399564:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126229888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100359.463548:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100360.485812:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100361.510508:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100361.774550:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100361.774596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100361.774686:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109421184 00000100:00100000:2.0:1790100361.774698:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109421184 00000100:00100000:2.0:1790100361.774769:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:2.0:1790100361.774780:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109421184:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100361.774858:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109421184:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100361.774868:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:3.0:1790100361.774936:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109421056 00000100:00100000:3.0:1790100361.774942:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109421056 00000100:00100000:3.0:1790100361.774979:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:3.0:1790100361.774987:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109421056:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100361.775017:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109421056:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 31us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100361.775023:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00080000:0.0:1790100361.775376:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1790100362.153815:0:10123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:06:00 (1790100360) === 00010000:00010000:0.0:1790100362.533809:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100362.591117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100362.591202:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109421312 00000100:00100000:1.0:1790100362.591215:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109421312 00000100:00100000:1.0:1790100362.591294:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 202 00000100:00100000:1.0:1790100362.591306:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:8154:x1877056109421312:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790100362.591329:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100362.591351:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780031400/0x31a8f3fdeeefcf8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64b53 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100362.591384:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780031400/0x31a8f3fdeeefcf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b53 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100362.591397:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780031400/0x31a8f3fdeeefcf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b53 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100362.591407:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780031400, rc 0) 00000100:00100000:1.0:1790100362.592346:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8154:x1877056109421312:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 1037us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100362.592355:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 202 00000100:00100000:3.0:1790100362.603500:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100362.603574:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109421440 00000100:00100000:2.0:1790100362.603590:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109421440 00000100:00100000:2.0:1790100362.603694:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:2.0:1790100362.603707:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8154:x1877056109421440:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790100362.604057:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8154:x1877056109421440:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 352us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100362.604066:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:0.0:1790100362.610687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100362.610782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109421568 00000100:00100000:1.0:1790100362.610791:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109421568 00000100:00100000:1.0:1790100362.610839:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 204 00000100:00100000:1.0:1790100362.610846:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8154:x1877056109421568:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790100362.611161:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8154:x1877056109421568:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 314us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100362.611167:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 204 00000100:00100000:0.0:1790100362.623721:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100362.623881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109421696 00000100:00100000:3.0:1790100362.623893:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109421696 00000100:00100000:3.0:1790100362.623964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:3.0:1790100362.623974:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8158:x1877056109421696:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790100362.624255:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8158:x1877056109421696:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 280us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100362.624265:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:3.0:1790100362.643654:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100362.643773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109421824 00000100:00100000:1.0:1790100362.643783:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109421824 00000100:00100000:1.0:1790100362.643828:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:1.0:1790100362.643835:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8158:x1877056109421824:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100362.644184:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8158:x1877056109421824:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 349us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100362.644191:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:0.0:1790100362.649595:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100362.657325:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109421952 00000100:00100000:2.0:1790100362.657344:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109421952 00000100:00100000:2.0:1790100362.657438:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:2.0:1790100362.657451:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:8154:x1877056109421952:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100362.657478:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100362.657515:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcf95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64b7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100362.657550:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcf95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b7d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100362.657563:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcf95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b7d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100362.657573:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781657200, rc 0) 00000100:00100000:2.0:1790100362.658519:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:8154:x1877056109421952:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 1066us (8929us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100362.658528:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:0.0:1790100362.667312:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100362.667414:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109422080 00000100:00100000:1.0:1790100362.667426:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109422080 00000100:00100000:1.0:1790100362.667549:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 208 00000100:00100000:1.0:1790100362.667562:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:8154:x1877056109422080:12345-192.168.201.18@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790100362.667593:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790100362.667776:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790100362.667781:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790100362.667785:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790100362.667787:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1790100362.681132:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:8154:x1877056109422080:12345-192.168.201.18@tcp:256:mount.lustre.0 Request processed in 13562us (13818us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100362.681148:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 208 00000100:00100000:0.0:1790100362.688244:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100362.688426:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109422208 00000100:00100000:2.0:1790100362.688439:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109422208 00000100:00100000:2.0:1790100362.688515:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:2.0:1790100362.688528:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:8154:x1877056109422208:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100362.688554:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100362.688683:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64b84 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100362.688880:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b84 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100362.688894:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b84 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100362.688907:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781656800, rc 0) 00000100:00100000:2.0:1790100362.689830:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:8154:x1877056109422208:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 1296us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100362.689865:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:0.0:1790100362.699152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100362.699360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109422336 00000100:00100000:1.0:1790100362.699373:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109422336 00000100:00100000:1.0:1790100362.699491:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:1.0:1790100362.699503:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:8154:x1877056109422336:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790100362.699945:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:8154:x1877056109422336:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 443us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100362.699954:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:3.0:1790100362.704282:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100362.704474:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109422464 00000100:00100000:2.0:1790100362.704488:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109422464 00000100:00100000:2.0:1790100362.704559:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:2.0:1790100362.704570:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:8154:x1877056109422464:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790100362.704942:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:8154:x1877056109422464:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 373us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100362.704951:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:2.0:1790100362.717226:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100362.717341:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109422592 00000100:00100000:0.0:1790100362.717355:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109422592 00000100:00100000:0.0:1790100362.717482:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:0.0:1790100362.717495:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:8162:x1877056109422592:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100362.717935:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:8162:x1877056109422592:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 439us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100362.717945:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:0.0:1790100362.724292:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100362.724415:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109422720 00000100:00100000:1.0:1790100362.724429:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109422720 00000100:00100000:1.0:1790100362.724515:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:1.0:1790100362.724528:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:8162:x1877056109422720:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100362.724922:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:8162:x1877056109422720:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 395us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100362.724930:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:1.0:1790100362.730490:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100362.730998:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109423232 00000100:00100000:0.0:1790100362.731011:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109423232 00000100:00100000:0.0:1790100362.731103:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:0.0:1790100362.731115:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109423232:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100362.731350:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109423232:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 236us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100362.731358:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1790100362.734206:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100362.735581:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109422848 00000100:00100000:1.0:1790100362.735599:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109422848 00000100:00100000:1.0:1790100362.735716:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1790100362.735727:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2356:x1877056109422848:12345-192.168.201.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790100362.735909:0:6711:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d25abe39-6b64-46c4-a568-4506410538f0@192.168.201.18@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1790100362.735963:0:6711:0:(genops.c:1384:class_connect()) connect: client d25abe39-6b64-46c4-a568-4506410538f0, cookie 0x31a8f3fdeeefcfa3 00000004:00100000:1.0:1790100362.736008:0:6711:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790100362.736394:0:6711:0:(import.c:65:import_set_state_nolock()) ffff8d67bf591000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100362.736511:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25abe39-6b64-46c4-a568-4506410538f0+6:2356:x1877056109422848:12345-192.168.201.18@tcp:38:mount.lustre.0 Request processed in 783us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100362.736541:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1790100362.744514:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100362.744878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100362.744914:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109422976 00000100:00100000:0.0:1790100362.744928:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109422976 00000100:00100000:3.0:1790100362.744942:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109423104 00000100:00100000:3.0:1790100362.744948:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109423104 00000100:00080000:0.0:1790100362.745006:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100362.745031:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1790100362.745045:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+7:8154:x1877056109423104:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790100362.745107:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790100362.745147:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1790100362.745158:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+7:0:x1877056109422976:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790100362.745189:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790100362.752902:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+7:8154:x1877056109423104:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 7841us (8006us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100362.752923:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:1.0:1790100362.753001:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+6:0:x1877056109422976:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 7843us (8501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100362.753011:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1790100362.758960:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100362.759080:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109423360 00000100:00100000:0.0:1790100362.759093:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109423360 00000100:00100000:0.0:1790100362.759185:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1790100362.759198:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25abe39-6b64-46c4-a568-4506410538f0+6:8154:x1877056109423360:12345-192.168.201.18@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790100362.759535:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25abe39-6b64-46c4-a568-4506410538f0+6:8154:x1877056109423360:12345-192.168.201.18@tcp:40:mount.lustre.0 Request processed in 339us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100362.759544:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1790100362.769469:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100362.769507:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100362.769587:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100362.769798:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109423488 00000100:00100000:1.0:1790100362.769813:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109423488 00000100:00100000:0.0:1790100362.769843:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109423616 00000100:00100000:0.0:1790100362.769851:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109423616 00000100:00100000:1.0:1790100362.769875:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1790100362.769900:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1877056109423488:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790100362.769943:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d25abe39-6b64-46c4-a568-4506410538f0@192.168.201.18@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1790100362.769987:0:6689:0:(genops.c:1384:class_connect()) connect: client d25abe39-6b64-46c4-a568-4506410538f0, cookie 0x31a8f3fdeeefcfaa 00002000:00100000:1.0:1790100362.770002:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d25abe39-6b64-46c4-a568-4506410538f0/ffff8d67bf596800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790100362.770037:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790100362.770778:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790100362.770821:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8d67bf594800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100362.770913:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+6:2356:x1877056109423488:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 1011us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100362.770941:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109423744 00000100:00100000:2.0:1790100362.770949:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109423744 00000100:00100000:2.0:1790100362.771001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:2.0:1790100362.771011:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25abe39-6b64-46c4-a568-4506410538f0+6:8154:x1877056109423744:12345-192.168.201.18@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790100362.771114:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790100362.771185:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25abe39-6b64-46c4-a568-4506410538f0+6:8154:x1877056109423744:12345-192.168.201.18@tcp:33:mount.lustre.0 Request processed in 176us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100362.771193:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:1.0:1790100362.778794:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1790100362.778869:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:1.0:1790100362.778882:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1877056109423616:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790100362.778954:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d25abe39-6b64-46c4-a568-4506410538f0@192.168.201.18@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1790100362.779009:0:6689:0:(genops.c:1384:class_connect()) connect: client d25abe39-6b64-46c4-a568-4506410538f0, cookie 0x31a8f3fdeeefcfb1 00002000:00100000:1.0:1790100362.779030:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d25abe39-6b64-46c4-a568-4506410538f0/ffff8d67bf596000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790100362.779064:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790100362.781833:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790100362.781901:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8d67bf595800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100362.782013:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+6:2356:x1877056109423616:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 3130us (12501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100362.782027:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1790100363.495045:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126230272:0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.495123:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100363.495182:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100363.495189:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126230400:0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.495216:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100363.495256:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126230272 00000100:00100000:2.0:1790100363.495277:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126230272 00000100:00100000:2.0:1790100363.495339:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790100363.495349:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126230272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100363.495360:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126230016:0@lo:400:kworker.0 00000100:00100000:0.0:1790100363.495401:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100363.495458:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126230144:0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.498077:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126230272:12345-0@lo:400:kworker.0 Request processed in 2719us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100363.498092:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790100363.498148:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126230400 00000100:00100000:2.0:1790100363.498158:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126230400 00000100:00100000:2.0:1790100363.498209:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790100363.498218:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126230400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.498278:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126230400:12345-0@lo:400:kworker.0 Request processed in 62us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100363.498285:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790100363.498301:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100363.498306:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790100363.498340:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad4e1f80 x1877056126230400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100363.498463:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126230400:0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.498480:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126230272:0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.498536:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126230016 00000100:00100000:2.0:1790100363.498540:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126230016 00000100:00100000:0.0:1790100363.498660:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126230528:0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.498663:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1790100363.498675:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126230016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100363.498704:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100363.498739:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126230528 00000100:00100000:0.0:1790100363.498743:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126230528 00000100:00100000:0.0:1790100363.498783:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790100363.498792:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126230528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.498798:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126230016:12345-0@lo:400:kworker.0 Request processed in 123us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100363.498806:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1790100363.498835:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126230528:12345-0@lo:400:kworker.0 Request processed in 44us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100363.498843:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1790100363.498865:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100363.498895:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126230016:0@lo:400:kworker.0 00000100:00100000:0.0:1790100363.498906:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126230528:0@lo:400:kworker.0 00000100:00100000:3.0:1790100363.499776:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100363.499790:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126230784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100363.499833:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100363.499870:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126230784 00000100:00100000:3.0:1790100363.499875:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126230784 00000100:00100000:3.0:1790100363.499911:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790100363.499919:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126230784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100363.499938:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100363.499977:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126230784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100363.499984:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1790100363.500013:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787dea300 x1877056126230784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100363.500029:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126230784:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790100363.500413:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100363.500482:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100363.500518:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126230656:0@lo:400:kworker.0 00000100:00100000:1.0:1790100363.500546:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100363.500607:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126230656 00000100:00100000:0.0:1790100363.500627:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126230656 00000100:00100000:0.0:1790100363.500661:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100363.500672:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126230656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100363.500713:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126230656:12345-0@lo:400:kworker.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100363.500721:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1790100363.500893:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6784e40a80 x1877056126230656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100363.500904:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126230656:0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.502547:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126230144 00000100:00100000:2.0:1790100363.502561:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126230144 00000100:00100000:2.0:1790100363.502643:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790100363.502654:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126230144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100363.502743:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126230144:12345-0@lo:400:kworker.0 Request processed in 92us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100363.502751:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790100363.502815:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126230144:0@lo:400:kworker.0 00010000:00010000:3.0:1790100363.557815:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100364.517903:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100364.517929:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126230912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100364.518021:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100364.518092:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126230912 00000100:00100000:0.0:1790100364.518100:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126230912 00000100:00100000:0.0:1790100364.518150:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100364.518160:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126230912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100364.518197:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100364.518246:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126230912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100364.518253:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1790100364.518294:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5e8e00 x1877056126230912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100364.518312:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126230912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100364.581937:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790100365.580817:0:5863:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d25abe39-6b64-46c4-a568-4506410538f0 00010000:00010000:3.0:1790100365.605964:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790100366.169908:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d25abe39-6b64-46c4-a568-4506410538f0 00010000:00010000:0.0:1790100366.630089:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790100367.360128:0:10316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:2.0:1790100367.637905:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d25abe39-6b64-46c4-a568-4506410538f0 00010000:00010000:3.0:1790100367.656353:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100367.924301:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100367.924380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100367.924423:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100367.924466:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100367.924598:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109423872 00000100:00100000:1.0:1790100367.924657:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109423872 00000100:00100000:1.0:1790100367.924722:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:3.0:1790100367.924734:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100367.924739:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109423872:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100367.924788:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109424000 00000100:00100000:3.0:1790100367.924794:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109424000 00000100:00100000:3.0:1790100367.924902:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109424128 00000100:00100000:3.0:1790100367.924924:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109424128 00000100:00100000:3.0:1790100367.924956:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:3.0:1790100367.924965:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109424000:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100367.924978:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109423872:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 244us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100367.924988:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:3.0:1790100367.925010:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109424000:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 45us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100367.925019:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:3.0:1790100367.925038:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:3.0:1790100367.925046:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109424128:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100367.925077:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109424128:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 32us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100367.925143:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00080000:1.0:1790100367.925178:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100367.925192:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109424256 00000100:00100000:1.0:1790100367.925196:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109424256 00000100:00100000:1.0:1790100367.925233:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109424384 00000100:00100000:1.0:1790100367.925236:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109424384 00000100:00100000:2.0:1790100367.925406:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:2.0:1790100367.925418:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109424256:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100367.925467:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109424256:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 52us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100367.925474:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00080000:0.0:1790100367.925633:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100367.925637:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100367.926156:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:1.0:1790100367.926168:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109424384:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100367.926217:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109424384:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 54us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100367.926224:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:1.0:1790100368.613880:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100368.613909:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126231040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100368.614001:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100368.615672:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126231040 00000100:00100000:3.0:1790100368.615691:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126231040 00000100:00100000:3.0:1790100368.615773:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790100368.615785:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126231040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100368.615847:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100368.615944:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126231040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100368.615953:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1790100368.616013:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5ee300 x1877056126231040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100368.616040:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126231040:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790100368.616364:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100368.618997:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126231552:0@lo:400:kworker.0 00000100:00100000:0.0:1790100368.619096:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100368.619151:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790100368.619157:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126231168:0@lo:400:kworker.0 00000100:00100000:0.0:1790100368.619186:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100368.619220:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126231680:0@lo:400:kworker.0 00000100:00100000:0.0:1790100368.619246:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100368.619272:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae66a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126231296:0@lo:400:kworker.0 00000100:00100000:0.0:1790100368.619304:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100368.619321:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100368.619327:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126231424:0@lo:400:kworker.0 00000100:00100000:0.0:1790100368.619354:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100368.619395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126231168 00000100:00100000:0.0:1790100368.619404:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126231168 00000100:00100000:0.0:1790100368.619458:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1790100368.619466:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126231168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100368.619523:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126231168:12345-0@lo:400:kworker.0 Request processed in 56us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100368.619531:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1790100368.619590:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126231168:0@lo:400:kworker.0 00000100:00100000:3.0:1790100368.619801:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126231680 00000100:00100000:3.0:1790100368.619806:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126231680 00000100:00100000:3.0:1790100368.619849:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126231296 00000100:00100000:3.0:1790100368.619858:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126231296 00000100:00100000:3.0:1790100368.619872:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126231424 00000100:00100000:3.0:1790100368.619874:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126231424 00000100:00100000:3.0:1790100368.619888:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790100368.619894:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126231680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100368.619937:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126231680:12345-0@lo:400:kworker.0 Request processed in 44us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100368.619944:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790100368.619958:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790100368.619963:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126231296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100368.619996:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126231296:12345-0@lo:400:kworker.0 Request processed in 33us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100368.620002:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790100368.620014:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790100368.620020:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126231424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100368.620045:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126231424:12345-0@lo:400:kworker.0 Request processed in 26us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100368.620051:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1790100368.620075:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100368.620103:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126231424:0@lo:400:kworker.0 00000100:00100000:3.0:1790100368.620113:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae66a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126231296:0@lo:400:kworker.0 00000100:00100000:3.0:1790100368.620139:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126231680:0@lo:400:kworker.0 00000100:00100000:1.0:1790100368.620222:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126231552 00000100:00100000:1.0:1790100368.620227:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126231552 00000100:00100000:1.0:1790100368.620273:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790100368.620282:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126231552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100368.620323:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126231552:12345-0@lo:400:kworker.0 Request processed in 43us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100368.620329:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1790100368.621731:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790100368.621788:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67852ce300 x1877056126231552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100368.621831:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126231552:0@lo:400:kworker.0 00010000:00010000:2.0:1790100368.678851:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100369.639109:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100369.642874:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126231808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100369.642984:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100369.648600:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126231808 00000100:00100000:0.0:1790100369.648638:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126231808 00000100:00100000:1.0:1790100369.649733:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790100369.649756:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126231808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100369.649810:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100369.649919:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126231808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (6935us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100369.649937:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1790100369.651949:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6787b83800 x1877056126231808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100369.651984:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126231808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100369.708166:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100370.728281:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100371.759848:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100372.774788:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100373.045349:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100373.045395:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100373.045421:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100373.045442:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100373.045467:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100373.045498:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109424768 00000100:00100000:2.0:1790100373.045509:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109424768 00000100:00100000:2.0:1790100373.045573:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109424640 00000100:00100000:2.0:1790100373.045577:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109424640 00000100:00100000:2.0:1790100373.045603:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:2.0:1790100373.045645:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109424768:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100373.045980:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109424768:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 366us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100373.045989:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:2.0:1790100373.046011:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:2.0:1790100373.046018:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109424640:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100373.046044:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109424640:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100373.046051:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:2.0:1790100373.046070:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109425024 00000100:00100000:2.0:1790100373.046074:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109425024 00000100:00100000:2.0:1790100373.046101:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109424896 00000100:00100000:2.0:1790100373.046104:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109424896 00000100:00100000:2.0:1790100373.046121:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:2.0:1790100373.046126:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109425024:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100373.046152:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109425024:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 26us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100373.046158:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:2.0:1790100373.046169:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:2.0:1790100373.046174:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109424896:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100373.046195:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109424896:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 21us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100373.046200:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00080000:2.0:1790100373.046222:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100373.046225:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100373.046228:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100373.048956:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109424512 00000100:00100000:3.0:1790100373.048969:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109424512 00000100:00100000:3.0:1790100373.049088:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:3.0:1790100373.049098:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109424512:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100373.049645:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109424512:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 545us (4304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100373.049653:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:1.0:1790100373.733857:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126232320:0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.733931:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100373.733994:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790100373.734000:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126231936:0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.734028:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100373.734054:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126232448:0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.734077:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100373.734102:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126232064:0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.734124:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100373.734141:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126232576:0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.734161:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100373.734179:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100373.734185:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126232192:0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.734204:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100373.734237:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126232320 00000100:00100000:1.0:1790100373.734246:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126232320 00000100:00100000:1.0:1790100373.734315:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126232576 00000100:00100000:1.0:1790100373.734318:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126232576 00000100:00100000:1.0:1790100373.734337:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790100373.734345:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126232320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.734401:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126232320:12345-0@lo:400:kworker.0 Request processed in 55us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100373.734408:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790100373.734426:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100373.734439:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126232576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.734473:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126232576:12345-0@lo:400:kworker.0 Request processed in 34us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100373.734479:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100373.734497:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126231936 00000100:00100000:1.0:1790100373.734501:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126231936 00000100:00080000:0.0:1790100373.735673:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100373.735680:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100373.735696:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126232448 00000100:00100000:0.0:1790100373.735703:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126232448 00000100:00100000:0.0:1790100373.735751:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126232064 00000100:00100000:0.0:1790100373.735755:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126232064 00000100:00100000:0.0:1790100373.735765:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126232192 00000100:00100000:0.0:1790100373.735767:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126232192 00000100:00100000:0.0:1790100373.735782:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100373.735790:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126232448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100373.735856:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126232448:12345-0@lo:400:kworker.0 Request processed in 67us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100373.735862:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100373.735878:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790100373.735883:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126232064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100373.735909:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126232064:12345-0@lo:400:kworker.0 Request processed in 25us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100373.735914:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790100373.735923:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790100373.735928:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126232192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100373.735951:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126232192:12345-0@lo:400:kworker.0 Request processed in 23us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100373.735955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1790100373.736025:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100373.737387:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1790100373.737399:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126231936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.737467:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126231936:12345-0@lo:400:kworker.0 Request processed in 71us (3437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100373.737474:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1790100373.737520:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126232704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100373.737556:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100373.737658:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126232192:0@lo:400:kworker.0 00000100:00100000:3.0:1790100373.737659:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126232704 00000100:00100000:3.0:1790100373.737665:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126232704 00000100:00100000:1.0:1790100373.737671:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126232064:0@lo:400:kworker.0 00010000:00080000:1.0:1790100373.737683:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6788c7df80 x1877056126232576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100373.737693:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126232576:0@lo:400:kworker.0 00000100:00100000:3.0:1790100373.737694:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790100373.737700:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126232704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100373.737729:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100373.737732:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126231936:0@lo:400:kworker.0 00000100:00100000:1.0:1790100373.737742:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126232448:0@lo:400:kworker.0 00010000:00080000:1.0:1790100373.737755:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6788c7d180 x1877056126232320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100373.737764:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126232320:0@lo:400:kworker.0 00000100:00100000:3.0:1790100373.737768:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126232704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100373.737774:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1790100373.737801:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5ee300 x1877056126232704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100373.737814:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126232704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790100373.798227:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100374.758519:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126232832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100374.758599:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100374.758731:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126232832 00000100:00100000:3.0:1790100374.758749:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126232832 00000100:00100000:3.0:1790100374.758840:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100374.758851:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126232832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790100374.758901:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100374.759708:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126232832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 855us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100374.759718:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1790100374.760075:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5e8700 x1877056126232832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100374.760095:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126232832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790100374.827778:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100375.850824:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100376.871709:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100377.897426:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100378.164026:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100378.164068:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100378.164138:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109425152 00000100:00100000:1.0:1790100378.164149:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109425152 00000100:00100000:1.0:1790100378.164209:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:1.0:1790100378.164220:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109425152:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100378.164295:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109425152:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 77us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100378.164303:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:2.0:1790100378.164470:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100378.170859:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100378.170906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100378.170938:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109425664 00000100:00100000:2.0:1790100378.170948:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109425664 00000100:00100000:2.0:1790100378.171005:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109425536 00000100:00100000:2.0:1790100378.171009:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109425536 00000100:00100000:2.0:1790100378.171028:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1790100378.171038:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109425664:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100378.171117:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109425664:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100378.171125:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1790100378.171142:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:2.0:1790100378.171149:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109425536:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100378.171174:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109425536:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100378.171180:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00080000:2.0:1790100378.171211:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100378.171215:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100378.173693:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109425280 00000100:00100000:0.0:1790100378.173706:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109425280 00000100:00100000:0.0:1790100378.174422:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109425408 00000100:00100000:0.0:1790100378.174428:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109425408 00000100:00100000:1.0:1790100378.174508:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:1.0:1790100378.174524:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109425280:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100378.174631:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109425280:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 113us (10562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100378.174639:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00080000:2.0:1790100378.178545:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100378.178793:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:0.0:1790100378.178807:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109425408:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100378.179013:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109425408:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 209us (14542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100378.179022:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:0.0:1790100378.854060:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126232960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100378.854134:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100378.854256:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126232960 00000100:00100000:2.0:1790100378.854265:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126232960 00000100:00100000:2.0:1790100378.854326:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100378.854334:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126232960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100378.854396:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790100378.854496:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100378.858457:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126232960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4113us (4312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100378.858472:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100378.858661:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126233088:0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.858726:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100378.858773:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126233600:0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.858803:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100378.858830:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100378.858851:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126233216:0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.858877:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100378.858911:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126233344:0@lo:400:kworker.0 00000100:00100000:2.0:1790100378.859016:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126233088 00000100:00100000:2.0:1790100378.859025:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126233088 00000100:00100000:2.0:1790100378.859358:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1790100378.859369:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126233088:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1790100378.859480:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5ee300 x1877056126232960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100378.859512:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126232960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100378.859536:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126233472:0@lo:400:kworker.0 00000100:00100000:2.0:1790100378.859596:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126233088:12345-0@lo:400:kworker.0 Request processed in 229us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100378.859604:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790100378.859824:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100378.859863:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126233600 00000100:00100000:1.0:1790100378.859869:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126233600 00000100:00100000:1.0:1790100378.859912:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126233216 00000100:00100000:1.0:1790100378.859916:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126233216 00000100:00100000:1.0:1790100378.859940:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126233344 00000100:00100000:1.0:1790100378.859943:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126233344 00000100:00100000:1.0:1790100378.859960:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790100378.859968:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126233600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.860310:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126233600:12345-0@lo:400:kworker.0 Request processed in 342us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100378.860317:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790100378.860332:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790100378.860339:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126233216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.860367:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126233216:12345-0@lo:400:kworker.0 Request processed in 29us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100378.860372:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790100378.860383:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790100378.860389:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126233344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.860414:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126233344:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100378.860420:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1790100378.860444:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100378.860465:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126233216:0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.860483:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126233088:0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.860491:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126233600:0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.860518:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126233344:0@lo:400:kworker.0 00000100:00100000:1.0:1790100378.860790:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100378.860897:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126233472 00000100:00100000:2.0:1790100378.860903:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126233472 00000100:00100000:2.0:1790100378.861032:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790100378.861041:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126233472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100378.861102:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126233472:12345-0@lo:400:kworker.0 Request processed in 62us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100378.861108:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1790100378.861356:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790100378.862907:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6788c7d880 x1877056126233472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100378.862925:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126233472:0@lo:400:kworker.0 00010000:00010000:2.0:1790100378.920705:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100379.881959:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100379.881984:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126233728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100379.882054:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100379.882152:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126233728 00000100:00100000:0.0:1790100379.882162:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126233728 00000100:00100000:0.0:1790100379.882225:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790100379.882235:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126233728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100379.882272:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100379.882326:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126233728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100379.882333:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1790100379.882373:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5eb100 x1877056126233728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100379.882393:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126233728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100379.941801:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100380.966050:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790100381.483472:0:11019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1790100381.989870:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100383.013808:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100383.281375:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100383.282044:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109426176 00000100:00100000:1.0:1790100383.282056:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109426176 00000100:00100000:1.0:1790100383.282195:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:1.0:1790100383.282207:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2356:x1877056109426176:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:1.0:1790100383.282250:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcfaa 00000100:00080000:1.0:1790100383.282263:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d67bf594800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100383.282301:0:6687:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790100383.282690:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25abe39-6b64-46c4-a568-4506410538f0+2:2356:x1877056109426176:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 483us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100383.282699:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00010000:00010000:1.0:1790100383.283231:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790100383.286036:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100383.294500:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100383.294548:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100383.294576:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100383.294686:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100383.294720:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109425792 00000100:00100000:0.0:1790100383.294732:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109425792 00000100:00100000:0.0:1790100383.294797:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:0.0:1790100383.294809:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2360:x1877056109425792:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100383.294880:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2360:x1877056109425792:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 73us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100383.294906:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:0.0:1790100383.294940:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109426048 00000100:00100000:0.0:1790100383.294943:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109426048 00000100:00100000:0.0:1790100383.294979:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109425920 00000100:00100000:0.0:1790100383.294983:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109425920 00000100:00100000:0.0:1790100383.295019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:0.0:1790100383.295026:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2360:x1877056109426048:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100383.295055:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2360:x1877056109426048:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100383.295061:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:0.0:1790100383.295072:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:0.0:1790100383.295078:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109425920:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100383.295100:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109425920:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 22us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100383.295117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00080000:0.0:1790100383.295159:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100383.295501:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109426304 00000100:00100000:1.0:1790100383.295506:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109426304 00000100:00100000:1.0:1790100383.295551:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:1.0:1790100383.295560:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2356:x1877056109426304:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:1.0:1790100383.295581:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcfb1 00000100:00080000:1.0:1790100383.295591:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8d67bf595800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100383.295656:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1790100383.295939:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100383.296026:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25abe39-6b64-46c4-a568-4506410538f0+2:2356:x1877056109426304:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 466us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100383.296045:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00010000:00010000:0.0:1790100383.296216:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100383.974028:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100383.974055:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126233856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100383.974144:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100383.974211:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126233856 00000100:00100000:0.0:1790100383.974220:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126233856 00000100:00100000:0.0:1790100383.974277:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790100383.974285:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126233856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100383.974319:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100383.974371:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126233856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100383.974378:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1790100383.974399:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790100383.974429:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5eb800 x1877056126233856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100383.974450:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126233856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100383.977367:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126234112:0@lo:400:kworker.0 00000100:00100000:3.0:1790100383.977436:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100383.977477:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100383.977483:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126234240:0@lo:400:kworker.0 00000100:00100000:3.0:1790100383.977506:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100383.977537:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126234112 00000100:00100000:3.0:1790100383.977545:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126234112 00000100:00100000:3.0:1790100383.977584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126234240 00000100:00100000:3.0:1790100383.977586:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126234240 00000100:00100000:3.0:1790100383.977629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790100383.977639:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126234112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100383.977697:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126234112:12345-0@lo:400:kworker.0 Request processed in 59us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100383.977704:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790100383.977720:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790100383.977726:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126234240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100383.977750:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126234240:12345-0@lo:400:kworker.0 Request processed in 25us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100383.977756:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1790100383.977777:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100383.977805:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126234240:0@lo:400:kworker.0 00000100:00100000:3.0:1790100383.977816:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126234112:0@lo:400:kworker.0 00000100:00100000:1.0:1790100383.977883:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126233984:0@lo:400:kworker.0 00000100:00100000:1.0:1790100383.977916:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100383.977952:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126234496:0@lo:400:kworker.0 00000100:00100000:1.0:1790100383.977973:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100383.977991:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100383.977997:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126234368:0@lo:400:kworker.0 00000100:00100000:1.0:1790100383.978020:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100383.978053:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126234368 00000100:00100000:1.0:1790100383.978057:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126234368 00000100:00100000:3.0:1790100383.978066:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126233984 00000100:00100000:3.0:1790100383.978069:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126233984 00000100:00100000:3.0:1790100383.978092:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1790100383.978092:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790100383.978108:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126233984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100383.978109:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126234368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100383.978141:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126234368:12345-0@lo:400:kworker.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100383.978147:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1790100383.978164:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100383.986052:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126233984:12345-0@lo:400:kworker.0 Request processed in 7939us (8119us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100383.986069:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00010000:00080000:1.0:1790100383.988983:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67852ce300 x1877056126234368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100383.989002:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126234368:0@lo:400:kworker.0 00000100:00100000:1.0:1790100383.989022:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126233984:0@lo:400:kworker.0 00000100:00100000:1.0:1790100383.989066:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126234496 00000100:00100000:1.0:1790100383.989073:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126234496 00000100:00100000:1.0:1790100383.989154:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790100383.989163:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126234496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100383.989270:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126234496:12345-0@lo:400:kworker.0 Request processed in 108us (11295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100383.989278:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790100383.989308:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126234496:0@lo:400:kworker.0 00000100:00080000:3.0:1790100383.989835:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790100384.038806:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100384.999230:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100385.000360:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126234624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100385.000441:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100385.004332:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126234624 00000100:00100000:1.0:1790100385.004348:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126234624 00000100:00100000:1.0:1790100385.004426:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790100385.004438:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126234624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100385.004479:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100385.004576:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126234624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (4134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100385.004583:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1790100385.004607:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790100385.004663:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6788c7f800 x1877056126234624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100385.004684:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126234624:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1790100385.030399:0:11167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcf942410 20000000:00000080:3.0:1790100385.030417:0:11167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d67ad19d400 uarg=0000000000000000 20000000:01000000:3.0:1790100385.030452:0:11167:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790100385.030457:0:11167:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790100385.030462:0:11167:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790100385.034202:0:11168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1790100385.034380:0:11167:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790100385.043380:0:11167:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790100385.043419:0:11167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.043441:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b4c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.043449:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf64 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.043456:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf72 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.043463:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf80 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.043470:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b84 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.043478:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.043520:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b84 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.043535:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b84 expref: 12 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.043550:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126234752:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100385.045150:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcf80 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.045182:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf80 expref: 18 pid: 5834 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.045198:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126234880:0@lo:104: 00000100:00100000:3.0:1790100385.045259:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100385.045307:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcf72 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.045316:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf72 expref: 18 pid: 5836 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.045324:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126235008:0@lo:104: 00000100:00100000:3.0:1790100385.045362:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100385.045395:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcf64 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.045403:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf64 expref: 18 pid: 5835 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.045412:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783504e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126235136:0@lo:104: 00000100:00100000:3.0:1790100385.045433:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100385.045453:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b4c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.045462:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b4c expref: 12 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.045472:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783504000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126235264:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100385.045519:0:11167:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100385.045803:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126234880 00000100:00100000:0.0:1790100385.045813:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126234880 00000100:00100000:0.0:1790100385.045854:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126235008 00000100:00100000:0.0:1790100385.045858:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126235008 00000100:00100000:0.0:1790100385.045868:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126235136 00000100:00100000:0.0:1790100385.045870:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126235136 00000100:00100000:0.0:1790100385.045884:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790100385.045894:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+5:11167:x1877056126234880:12345-0@lo:104: 00010000:00010000:0.0:1790100385.045909:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.045974:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100385.045981:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+5:11167:x1877056126234880:12345-0@lo:104: Request processed in 89us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100385.045988:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790100385.046007:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790100385.046013:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:11167:x1877056126235008:12345-0@lo:104: 00010000:00010000:0.0:1790100385.046021:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046065:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790100385.046070:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+4:11167:x1877056126235008:12345-0@lo:104: Request processed in 58us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100385.046088:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790100385.046103:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100385.046109:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:11167:x1877056126235136:12345-0@lo:104: 00010000:00010000:0.0:1790100385.046116:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046143:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790100385.046148:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+3:11167:x1877056126235136:12345-0@lo:104: Request processed in 41us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100385.046153:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1790100385.046170:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790100385.046176:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046184:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af000 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1790100385.046188:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046198:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100385.046205:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100385.046212:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790100385.046251:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046258:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100385.046282:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046290:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67900af000/0x31a8f3fdeeefcf80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcf87 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046304:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100385.046308:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046314:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780031800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1790100385.046317:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046324:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100385.046331:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100385.046336:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790100385.046348:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046354:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100385.046370:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046387:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6780031800/0x31a8f3fdeeefcf72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcf79 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046398:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100385.046401:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046407:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf530200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1790100385.046410:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046417:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790100385.046424:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100385.046429:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790100385.046443:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046449:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790100385.046455:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046461:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67bf530200/0x31a8f3fdeeefcf64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcf6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046475:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100385.046482:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100385.046483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100385.046490:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100385.046507:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100385.046521:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126235392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100385.046557:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100385.046583:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126235520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100385.046606:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100385.046653:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100385.046659:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126235648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100385.046681:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100385.046712:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126235392 00000100:00100000:0.0:1790100385.046717:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126235392 00010000:00010000:0.0:1790100385.046740:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf80 expref: 19 pid: 5834 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100385.046755:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126235520 00000100:00100000:0.0:1790100385.046758:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126235520 00010000:00010000:0.0:1790100385.046769:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf72 expref: 20 pid: 5836 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100385.046779:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126235648 00000100:00100000:0.0:1790100385.046781:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126235648 00010000:00010000:0.0:1790100385.046792:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf64 expref: 21 pid: 5835 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100385.046804:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100385.046811:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+21:3313:x1877056126235392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100385.046822:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100385.046827:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf80 expref: 21 pid: 5834 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046843:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf80 expref: 21 pid: 5834 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046859:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100385.046890:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+21:3313:x1877056126235392:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100385.046897:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100385.046937:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790100385.046942:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+20:3311:x1877056126235520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100385.046949:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100385.046954:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf72 expref: 20 pid: 5836 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046961:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf72 expref: 20 pid: 5836 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.046971:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100385.046996:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+20:3311:x1877056126235520:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100385.047002:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790100385.047015:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100385.047022:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126235648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100385.047029:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100385.047033:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf64 expref: 19 pid: 5835 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.047041:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf64 expref: 19 pid: 5835 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100385.047057:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100385.047091:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126235648:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100385.047097:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100385.047137:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126235392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100385.047161:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126235648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100385.047168:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126235520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100385.047936:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780030600/0x31a8f3fdeeefcf87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf80 expref: 18 pid: 5834 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.047951:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126234880:0@lo:104: 00010000:00010000:3.0:1790100385.047961:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781657800/0x31a8f3fdeeefcf79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf72 expref: 17 pid: 5836 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.047970:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126235008:0@lo:104: 00010000:00010000:3.0:1790100385.047979:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67900ae000/0x31a8f3fdeeefcf6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcf64 expref: 16 pid: 5835 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.047987:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783504e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126235136:0@lo:104: 00000100:00100000:0.0:1790100385.056413:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100385.056456:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100385.056542:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109426432 00000100:00100000:2.0:1790100385.056565:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109426432 00010000:00010000:2.0:1790100385.056605:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b84 expref: 13 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100385.056670:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109426560 00000100:00100000:2.0:1790100385.056674:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109426560 00010000:00010000:2.0:1790100385.056686:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b4c expref: 14 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100385.056702:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:2.0:1790100385.056712:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+14:2357:x1877056109426432:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100385.056727:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100385.056733:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b84 expref: 14 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056745:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b84 expref: 14 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056767:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100385.056832:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+14:2357:x1877056109426432:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 121us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100385.056840:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:2.0:1790100385.056858:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:2.0:1790100385.056864:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109426560:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100385.056871:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100385.056876:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b4c expref: 13 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056884:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b4c expref: 13 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056903:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056912:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056928:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056936:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056943:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056950:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056956:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aee00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100385.056960:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056969:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056977:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.056986:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100385.057006:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109426560:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 141us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100385.057020:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00010000:00010000:3.0:1790100385.057530:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcf9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b84 expref: 12 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.057557:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126234752:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100385.057571:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf530e00/0x31a8f3fdeeefcf5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b4c expref: 11 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100385.057579:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783504000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1877056126235264:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100385.057642:0:11167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.057654:0:11167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.057661:0:11167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100385.057683:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefcfb8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100385.063411:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100386.091208:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790100386.216492:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100386.216500:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6787677800 from 7 10000000:01000000:1.0:1790100386.216505:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100386.216555:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100386.216569:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100386.216580:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100386.216606:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126235776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100386.216949:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100386.216998:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6782baaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100386.217363:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126235776 00000100:00100000:0.0:1790100386.217372:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126235776 00000100:00100000:0.0:1790100386.217428:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790100386.217437:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126235776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100386.217450:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100386.217464:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcfbf expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100386.217489:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcfbf expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100386.217500:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcfbf expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100386.217508:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf531a00, rc 0) 00000100:00100000:0.0:1790100386.217557:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126235776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.217572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1790100386.217655:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126235776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100386.217671:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100386.217681:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100386.217743:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126235904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100386.217772:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.221537:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758540 going to sleep for 11 seconds 00000100:00100000:2.0:1790100386.221811:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126235904 00000100:00100000:2.0:1790100386.221822:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126235904 00000100:00100000:2.0:1790100386.221867:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790100386.221877:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126235904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100386.222159:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126235904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (4386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100386.222166:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1790100386.222872:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126235904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100386.222926:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100386.222978:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.223015:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758540 going to sleep for 11 seconds 00000100:00100000:3.0:1790100386.223076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126236032 00000100:00100000:3.0:1790100386.223084:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126236032 00000100:00100000:3.0:1790100386.223124:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1790100386.223133:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126236032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100386.223321:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126236032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100386.223330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1790100386.223871:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790100386.224797:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790100386.224947:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790100386.224965:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100386.224975:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.224987:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100386.224997:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790100386.225000:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67ad888800 from 7 10000000:01000000:3.0:1790100386.225003:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100386.225039:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.225047:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.225067:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100386.225103:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783504000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100386.225160:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100386.225271:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100386.225443:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126236160 00000100:00100000:2.0:1790100386.225452:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126236160 00000100:00100000:2.0:1790100386.225495:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1790100386.225505:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126236160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100386.225517:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100386.225529:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcfcd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100386.225552:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcfcd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100386.225564:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcfcd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100386.225572:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781656800, rc 0) 00000100:00100000:2.0:1790100386.225706:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126236160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100386.225723:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1790100386.227652:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783504000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100386.227678:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100386.227691:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100386.227766:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100386.227829:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.227869:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758540 going to sleep for 11 seconds 00000100:00100000:3.0:1790100386.227942:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126236288 00000100:00100000:3.0:1790100386.227950:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126236288 00000100:00100000:3.0:1790100386.228000:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1790100386.228009:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126236288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100386.228282:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126236288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100386.228289:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790100386.228579:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100386.228643:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100386.228684:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100386.228708:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758540 going to sleep for 11 seconds 00000100:00100000:3.0:1790100386.228944:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126236416 00000100:00100000:3.0:1790100386.228950:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126236416 00000100:00100000:3.0:1790100386.228983:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1790100386.228991:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126236416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100386.229162:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126236416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100386.229169:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790100386.229276:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100386.230460:0:11198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790100386.232126:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790100386.232156:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100386.232168:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.232182:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100386.232268:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790100386.232277:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6788844800 from 7 10000000:01000000:3.0:1790100386.232280:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100386.232387:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.232396:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.232406:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100386.232433:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783504e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100386.232508:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100386.232557:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100386.232638:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126236544 00000100:00100000:1.0:1790100386.232647:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126236544 00000100:00100000:1.0:1790100386.232695:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1790100386.232706:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126236544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100386.232719:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100386.232732:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefcfdb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100386.232755:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcfdb expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100386.232766:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcfdb expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100386.232774:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6780031600, rc 0) 00000100:00100000:1.0:1790100386.232812:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126236544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100386.232819:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1790100386.232915:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783504e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100386.232931:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.232941:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100386.232995:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783504e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100386.233021:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100386.233048:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100386.233095:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126236672 00000100:00100000:1.0:1790100386.233100:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126236672 00000100:00100000:1.0:1790100386.233128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1790100386.233134:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126236672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100386.233521:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126236672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 386us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100386.233535:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1790100386.233605:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783504e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100386.233664:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783504e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100386.233701:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100386.233720:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100386.233980:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126236800 00000100:00100000:1.0:1790100386.233986:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126236800 00000100:00100000:1.0:1790100386.234020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790100386.234028:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126236800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100386.234261:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126236800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100386.234267:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790100386.234437:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783504e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126236800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100386.236097:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790100386.236581:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790100386.236601:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100386.236638:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.236651:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100386.417271:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100386.417553:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109426688 00000100:00100000:0.0:1790100386.417564:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109426688 00000100:00100000:0.0:1790100386.417636:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:0.0:1790100386.417648:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:5596:x1877056109426688:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100386.417665:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100386.417683:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100386.417712:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bae expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100386.417725:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bae expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100386.417735:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf531400, rc 0) 00000100:00100000:0.0:1790100386.417787:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109426688:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 141us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100386.417794:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:2.0:1790100386.434601:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100386.434838:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109426816 00000100:00100000:1.0:1790100386.434850:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109426816 00000100:00100000:1.0:1790100386.434903:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 233 00000100:00100000:1.0:1790100386.434913:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109426816:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100386.435272:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109426816:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 359us (6992us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100386.435280:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 233 00000100:00100000:0.0:1790100386.452417:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100386.452548:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109426944 00000100:00100000:2.0:1790100386.452560:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109426944 00000100:00100000:2.0:1790100386.452635:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 234 00000100:00100000:2.0:1790100386.452645:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109426944:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100386.452871:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109426944:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 226us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100386.452879:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 234 00000100:00100000:1.0:1790100386.462113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100386.462159:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109427072 00000100:00100000:3.0:1790100386.462171:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109427072 00000100:00100000:3.0:1790100386.462237:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 235 00000100:00100000:3.0:1790100386.462248:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109427072:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100386.462266:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100386.462286:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bb5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.462313:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bb5 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.462325:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bb5 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100386.462334:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900aec00, rc 0) 00000100:00100000:3.0:1790100386.462392:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109427072:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 145us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100386.462400:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 235 00000100:00100000:0.0:1790100386.480490:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100386.483446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109427200 00000100:00100000:1.0:1790100386.483460:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109427200 00000100:00100000:1.0:1790100386.483525:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 236 00000100:00100000:1.0:1790100386.483536:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109427200:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100386.483872:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109427200:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 337us (3389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100386.483881:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 236 00000100:00100000:0.0:1790100386.490192:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100386.490698:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109427328 00000100:00100000:1.0:1790100386.490716:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109427328 00000100:00100000:1.0:1790100386.490777:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 237 00000100:00100000:1.0:1790100386.490788:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109427328:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100386.490996:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109427328:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 209us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100386.491005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 237 00000001:00100000:2.0:1790100386.601840:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d25abe39-6b64-46c4-a568-4506410538f0 00000020:00000080:2.0:1790100386.601850:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d67bf596000/d25abe39-6b64-46c4-a568-4506410538f0 00000020:00000080:0.0:1790100386.601912:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf596000/d25abe39-6b64-46c4-a568-4506410538f0 for lustre-OST0001 00000020:00000080:0.0:1790100386.601966:0:487:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67bf595800 for lustre-OST0001 00010000:00010000:0.0:1790100387.109767:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790100388.111919:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d25abe39-6b64-46c4-a568-4506410538f0 00000020:00000080:3.0:1790100388.111938:0:6714:0:(genops.c:885:class_export_put()) final put ffff8d67bf596800/d25abe39-6b64-46c4-a568-4506410538f0 00000020:00000080:3.0:1790100388.111966:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf596800/d25abe39-6b64-46c4-a568-4506410538f0 for lustre-OST0000 00000020:00000080:3.0:1790100388.112006:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67bf594800 for lustre-OST0000 00010000:00010000:0.0:1790100388.134829:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100388.408140:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100388.410206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100388.410350:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109427456 00000100:00100000:2.0:1790100388.410361:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109427456 00000100:00100000:2.0:1790100388.410457:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 238 00000100:00100000:2.0:1790100388.410467:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109427456:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100388.410543:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109427456:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 77us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100388.410551:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 238 00000100:00100000:3.0:1790100388.410636:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109427712 00000100:00100000:3.0:1790100388.410642:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109427712 00000100:00100000:3.0:1790100388.410683:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:3.0:1790100388.410691:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109427712:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100388.410725:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109427712:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 36us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100388.410732:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00080000:0.0:1790100388.411696:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100388.412925:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100388.413794:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109427584 00000100:00100000:1.0:1790100388.413806:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109427584 00000100:00100000:1.0:1790100388.413912:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:1.0:1790100388.413924:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109427584:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100388.413996:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109427584:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 74us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100388.414004:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00080000:3.0:1790100388.420160:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1790100388.458346:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790100389.095595:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100389.095634:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126236928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100389.095707:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100389.096347:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126236928 00000100:00100000:0.0:1790100389.096359:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126236928 00000100:00100000:0.0:1790100389.096433:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790100389.096444:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126236928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100389.096483:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100389.096537:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126236928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100389.096545:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1790100389.096659:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790100389.096690:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5e8700 x1877056126236928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100389.096709:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126236928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100389.096944:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126237312:0@lo:400:kworker.0 00000100:00100000:1.0:1790100389.096980:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100389.097002:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100389.097036:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126237184:0@lo:400:kworker.0 00000100:00100000:1.0:1790100389.097062:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100389.097186:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126237440:0@lo:400:kworker.0 00000100:00100000:2.0:1790100389.097218:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100389.097255:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790100389.097260:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126237056:0@lo:400:kworker.0 00000100:00100000:2.0:1790100389.097289:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100389.097328:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126237568:0@lo:400:kworker.0 00000100:00100000:2.0:1790100389.097351:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100389.097376:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126237056 00000100:00100000:2.0:1790100389.097381:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126237056 00000100:00100000:2.0:1790100389.097411:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1790100389.097428:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126237056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100389.097468:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126237056:12345-0@lo:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100389.097474:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1790100389.097510:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126237056:0@lo:400:kworker.0 00000100:00100000:3.0:1790100389.097686:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126237312 00000100:00100000:3.0:1790100389.097690:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126237312 00000100:00100000:3.0:1790100389.097733:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126237184 00000100:00100000:3.0:1790100389.097736:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126237184 00000100:00100000:3.0:1790100389.097748:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126237568 00000100:00100000:3.0:1790100389.097751:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126237568 00000100:00100000:3.0:1790100389.097765:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790100389.097771:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126237312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100389.097823:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126237312:12345-0@lo:400:kworker.0 Request processed in 52us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100389.097830:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790100389.097843:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790100389.097848:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126237184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100389.097872:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126237184:12345-0@lo:400:kworker.0 Request processed in 24us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100389.097878:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790100389.097901:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790100389.097907:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126237568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100389.097936:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126237568:12345-0@lo:400:kworker.0 Request processed in 29us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100389.097942:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790100389.097974:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126237184:0@lo:400:kworker.0 00000100:00100000:3.0:1790100389.097983:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126237312:0@lo:400:kworker.0 00000100:00100000:3.0:1790100389.098004:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126237568:0@lo:400:kworker.0 00000100:00100000:1.0:1790100389.098176:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126237440 00000100:00100000:1.0:1790100389.098180:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126237440 00000100:00100000:1.0:1790100389.098218:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790100389.098225:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126237440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100389.098275:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126237440:12345-0@lo:400:kworker.0 Request processed in 51us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100389.098281:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1790100389.098440:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100389.098445:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790100389.098533:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6788c7ca80 x1877056126237440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100389.098544:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126237440:0@lo:400:kworker.0 00010000:00010000:0.0:1790100389.157909:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100390.118729:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100390.118753:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126237696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100390.118822:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100390.118887:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126237696 00000100:00100000:0.0:1790100390.118896:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126237696 00000100:00100000:0.0:1790100390.118937:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790100390.118946:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126237696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100390.118981:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100390.119040:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126237696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100390.119046:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1790100390.119092:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ae5e8700 x1877056126237696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100390.119109:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ae5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126237696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100390.182110:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100391.206586:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790100391.371888:0:11467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:06:29 (1790100389) === 00000100:00100000:3.0:1790100391.523007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100391.523220:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109427840 00000100:00100000:0.0:1790100391.523231:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109427840 00000100:00100000:3.0:1790100391.523299:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100391.523359:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109427968 00000100:00100000:1.0:1790100391.523365:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109427968 00000100:00100000:0.0:1790100391.523368:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1790100391.523379:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2360:x1877056109427840:12345-192.168.201.18@tcp:41:mkdir.0 00000100:00100000:1.0:1790100391.523399:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1790100391.523405:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:9705:x1877056109427968:12345-192.168.201.18@tcp:700:mkdir.0 00000004:00000024:0.0:1790100391.523423:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790100391.523473:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:9705:x1877056109427968:12345-192.168.201.18@tcp:700:mkdir.0 Request processed in 67us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.523473:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2360:x1877056109427840:12345-192.168.201.18@tcp:41:mkdir.0 Request processed in 96us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100391.523482:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1790100391.523482:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00080000:2.0:1790100391.523783:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100391.525465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100391.525894:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109428224 00000100:00100000:1.0:1790100391.525903:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109428224 00000100:00100000:1.0:1790100391.525977:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:1.0:1790100391.525988:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:9705:x1877056109428224:12345-192.168.201.18@tcp:36:mkdir.0 00010000:00010000:1.0:1790100391.526053:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100391.526117:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefced8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b37 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.526135:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:1.0:1790100391.526144:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100391.526447:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.526458:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.526466:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.526486:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.526499:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.526504:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100391.531551:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790100391.531640:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.531763:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.531770:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.531774:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780030800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100391.531777:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.531783:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.531796:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:1.0:1790100391.531798:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100391.531802:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.531806:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefcff7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100391.531833:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4673c46 reply state 00000000af4a43a6 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100391.531839:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790100391.531933:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:9705:x1877056109428224:12345-192.168.201.18@tcp:36:mkdir.0 Request processed in 5944us (6469us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790100391.531942:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00010000:00010000:1.0:1790100391.535213:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.535250:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.535259:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.535266:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780030600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100391.535270:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.535279:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.535298:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d6799df4200) 00010000:00010000:1.0:1790100391.535301:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100391.535306:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.535312:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefcffe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100391.539436:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100391.539511:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109428352 00000100:00100000:0.0:1790100391.539521:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109428352 00000100:00100000:0.0:1790100391.539584:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1790100391.539595:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:9706:x1877056109428352:12345-192.168.201.18@tcp:101:chmod.0 00010000:00010000:0.0:1790100391.539647:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100391.539674:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bbc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.539744:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd00c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.539759:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.539771:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100391.539815:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790100391.539818:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100391.539850:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd00c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.539871:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bbc expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.539884:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd00c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bbc expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.539890:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787edf000) 00010000:00010000:0.0:1790100391.539892:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100391.539895:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530200, rc 0) 00000100:00100000:0.0:1790100391.539956:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:9706:x1877056109428352:12345-192.168.201.18@tcp:101:chmod.0 Request processed in 364us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.539961:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1790100391.544732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100391.544810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109428608 00000100:00100000:2.0:1790100391.544819:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109428608 00000100:00100000:2.0:1790100391.544864:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1790100391.544871:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:9706:x1877056109428608:12345-192.168.201.18@tcp:36:chmod.0 00010000:00010000:2.0:1790100391.544929:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100391.544955:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd00c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bbc expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100391.544984:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787edf000) 00010000:00010000:2.0:1790100391.544999:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100391.545025:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100391.545038:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100391.545061:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100391.545354:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005686ed2c reply state 00000000207d2768 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100391.545364:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790100391.545371:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790100391.545504:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:9706:x1877056109428608:12345-192.168.201.18@tcp:36:chmod.0 Request processed in 632us (782us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790100391.545510:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00010000:00010000:2.0:1790100391.551711:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100391.551730:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100391.551738:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100391.551745:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781656200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100391.551749:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100391.551757:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100391.551773:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787def200) 00010000:00010000:2.0:1790100391.551777:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790100391.551784:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100391.551805:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781656200/0x31a8f3fdeeefd013 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100391.583928:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100391.584146:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109428736 00000100:00100000:3.0:1790100391.584156:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109428736 00000100:00100000:3.0:1790100391.584348:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1790100391.584438:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:9707:x1877056109428736:12345-192.168.201.18@tcp:101:chown.0 00010000:00010000:3.0:1790100391.584459:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100391.584479:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd01a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bc3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.584538:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd021 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.584553:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.584566:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100391.584596:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790100391.584599:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100391.584645:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.584676:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd01a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bc3 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.584690:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd021 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bc3 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.584696:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100391.584698:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100391.584712:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900aea00, rc 0) 00000100:00100000:3.0:1790100391.584806:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:9707:x1877056109428736:12345-192.168.201.18@tcp:101:chown.0 Request processed in 370us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100391.585709:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1790100391.588713:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100391.590834:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109428864 00000100:00100000:1.0:1790100391.590849:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109428864 00000100:00100000:1.0:1790100391.590929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1790100391.590940:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:9707:x1877056109428864:12345-192.168.201.18@tcp:101:chown.0 00010000:00010000:1.0:1790100391.591078:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100391.591153:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefd028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bca expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.591273:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.591346:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.591512:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.591532:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.591540:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.591547:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592076:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefd03d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592087:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefd03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592167:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefd03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100391.592264:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790100391.592268:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100391.592437:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefd03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592451:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592459:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592465:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592471:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780030800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100391.592475:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592484:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592497:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:1.0:1790100391.592501:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100391.592506:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592513:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030800/0x31a8f3fdeeefd02f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592541:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592548:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592554:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592559:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780031800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100391.592562:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592568:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592576:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d6799df4200) 00010000:00010000:1.0:1790100391.592579:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100391.592582:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592588:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780031800/0x31a8f3fdeeefd036 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592694:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6780030600/0x31a8f3fdeeefd028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bca expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592712:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefd03d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bca expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.592730:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:1.0:1790100391.592732:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100391.592735:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12400, rc 0) 00000100:00100000:1.0:1790100391.592854:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:9707:x1877056109428864:12345-192.168.201.18@tcp:101:chown.0 Request processed in 1914us (4149us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100391.592863:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:0.0:1790100391.599264:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100391.599413:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109429120 00000100:00100000:1.0:1790100391.599424:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109429120 00000100:00100000:1.0:1790100391.599524:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:1.0:1790100391.599535:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:9707:x1877056109429120:12345-192.168.201.18@tcp:36:chown.0 00010000:00010000:1.0:1790100391.599591:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100391.599641:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefd03d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bca expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.599661:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:1.0:1790100391.599672:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100391.599699:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.599712:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.599722:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100391.645055:0:6711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094d1b02d reply state 0000000047c138db transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100391.645075:0:6711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790100391.645091:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790100391.645222:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:9707:x1877056109429120:12345-192.168.201.18@tcp:36:chown.0 Request processed in 45685us (45964us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790100391.645232:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000001:00080000:2.0:1790100391.645794:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1790100391.646033:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.646044:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.646052:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.646059:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100391.646064:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.646073:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.646089:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6799df4200) 00010000:00010000:3.0:1790100391.646092:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790100391.646173:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.646181:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13c00/0x31a8f3fdeeefd044 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100391.677007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100391.678921:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109429248 00000100:00100000:2.0:1790100391.678934:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109429248 00000100:00100000:1.0:1790100391.679177:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:1.0:1790100391.679191:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:9708:x1877056109429248:12345-192.168.201.18@tcp:101:touch.500 00010000:00010000:1.0:1790100391.679318:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100391.679340:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefd04b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bd1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100391.683314:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3920us 00010000:00010000:3.0:1790100391.700124:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700146:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700159:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700175:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700181:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700186:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700475:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700482:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700487:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100391.700523:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790100391.700526:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100391.700555:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700565:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700580:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700587:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700593:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100391.700597:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700605:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700654:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100391.700658:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100391.700663:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700670:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd052 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700681:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700692:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700696:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700699:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100391.700702:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700706:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700712:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d6787ec1600) 00010000:00010000:3.0:1790100391.700713:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100391.700715:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700719:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd059 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700748:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefd04b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bd1 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700758:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bd1 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.700763:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6787ec1f00) 00010000:00010000:3.0:1790100391.700765:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790100391.700770:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af600, rc 0) 00000100:00100000:3.0:1790100391.700831:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:9708:x1877056109429248:12345-192.168.201.18@tcp:101:touch.500 Request processed in 21644us (23833us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100391.700838:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:0.0:1790100391.704757:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100391.704912:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109429504 00000100:00100000:3.0:1790100391.704925:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109429504 00000100:00100000:3.0:1790100391.704995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:3.0:1790100391.705008:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:9708:x1877056109429504:12345-192.168.201.18@tcp:101:touch.500 00010000:00010000:3.0:1790100391.705030:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100391.705050:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd067 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bd8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.705325:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.705341:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.705352:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.705365:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.705372:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.705378:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100391.706331:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1790100391.706535:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd07c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706545:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd07c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706552:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd07c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706582:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706589:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706596:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706602:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100391.706607:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706779:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706791:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6787ec1f00) 00010000:00010000:3.0:1790100391.706793:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100391.706798:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706802:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd06e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100391.706821:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f25668c4 reply state 00000000ab4485d8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100391.706827:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790100391.706854:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd067 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bd8 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706864:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd07c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bd8 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.706869:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d6787ec1400) 00010000:00010000:3.0:1790100391.706871:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100391.706872:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900afe00, rc 0) 00000100:00100000:3.0:1790100391.706982:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:9708:x1877056109429504:12345-192.168.201.18@tcp:101:touch.500 Request processed in 1977us (2411us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790100391.706988:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00010000:00010000:0.0:1790100391.709110:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.709126:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.709149:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.709155:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100391.709159:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.709166:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.709182:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff8d6787ec1600) 00010000:00010000:0.0:1790100391.709186:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100391.709190:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.709196:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd075 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100391.711491:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100391.711829:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109429760 00000100:00100000:3.0:1790100391.711840:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109429760 00000100:00100000:3.0:1790100391.711896:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:3.0:1790100391.711908:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:9708:x1877056109429760:12345-192.168.201.18@tcp:36:touch.500 00010000:00010000:3.0:1790100391.711982:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100391.712011:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd07c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bd8 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.712029:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d6787ec1400) 00010000:00010000:3.0:1790100391.712039:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100391.712090:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.712105:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.712115:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100391.712736:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c466eb7 reply state 00000000c980a7e5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100391.712748:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100391.712907:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:9708:x1877056109429760:12345-192.168.201.18@tcp:36:touch.500 Request processed in 999us (1423us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790100391.712915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00010000:00010000:3.0:1790100391.714998:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.715016:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.715024:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.715030:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100391.715035:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.715043:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.715060:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d6787ec1c00) 00010000:00010000:3.0:1790100391.715076:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100391.715082:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.715088:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd08a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100391.715437:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100391.715548:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109429888 00000100:00100000:1.0:1790100391.715560:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109429888 00000100:00100000:1.0:1790100391.715723:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1790100391.715736:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:9708:x1877056109429888:12345-192.168.201.18@tcp:101:touch.500 00010000:00010000:1.0:1790100391.715760:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100391.715779:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd091 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bdf expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.715834:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd091 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bdf expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.715848:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd091 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bdf expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.715867:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:1.0:1790100391.715871:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100391.715873:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13a00, rc 0) 00000100:00100000:1.0:1790100391.715973:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:9708:x1877056109429888:12345-192.168.201.18@tcp:101:touch.500 Request processed in 230us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100391.715980:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1790100391.720136:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100391.720221:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109430016 00000100:00100000:0.0:1790100391.720232:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109430016 00000100:00100000:0.0:1790100391.720283:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1790100391.720292:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1877056109430016:12345-192.168.201.18@tcp:8:touch.500 00010000:00080000:0.0:1790100391.720327:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1790100391.720359:0:6687:0:(genops.c:1384:class_connect()) connect: client dd2cd87b-6ca1-4323-9b74-fad785d94e6c, cookie 0x31a8f3fdeeefd098 00002000:00100000:0.0:1790100391.720371:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd2cd87b-6ca1-4323-9b74-fad785d94e6c/ffff8d67ad05a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790100391.720411:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790100391.720759:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790100391.720792:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d67ad05c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100391.720913:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2356:x1877056109430016:12345-192.168.201.18@tcp:8:touch.500 Request processed in 620us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.720921:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1790100391.730089:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100391.730159:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109430144 00000100:00100000:2.0:1790100391.730170:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109430144 00000100:00100000:2.0:1790100391.730251:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1790100391.730262:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad48a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:0:x1877056109430144:12345-192.168.201.18@tcp:2:touch.500 00000100:00080000:0.0:1790100391.730522:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1790100391.757807:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000001:00080000:0.0:1790100391.757832:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1790100391.758022:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad48a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:0:x1877056109430144:12345-192.168.201.18@tcp:2:touch.500 Request processed in 27756us (27936us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790100391.758034:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1790100391.761828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100391.762010:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109430400 00000100:00100000:2.0:1790100391.762022:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109430400 00000100:00100000:2.0:1790100391.762122:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:2.0:1790100391.762135:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:9708:x1877056109430400:12345-192.168.201.18@tcp:35:touch.500 00000100:00100000:2.0:1790100391.762603:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:9708:x1877056109430400:12345-192.168.201.18@tcp:35:touch.500 Request processed in 469us (783us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790100391.762636:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:1.0:1790100391.780716:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100391.780838:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109430528 00000100:00100000:3.0:1790100391.780849:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109430528 00000100:00100000:3.0:1790100391.780940:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:3.0:1790100391.780951:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:9709:x1877056109430528:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:3.0:1790100391.780985:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100391.781008:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd09f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64be6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.781078:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd0a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.781093:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.781103:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100391.781149:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790100391.781153:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100391.781189:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.781219:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd09f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64be6 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.781257:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64be6 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.781266:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6787ec1f00) 00010000:00010000:3.0:1790100391.781269:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100391.781273:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af800, rc 0) 00000100:00100000:3.0:1790100391.781337:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:9709:x1877056109430528:12345-192.168.201.18@tcp:101:rm.0 Request processed in 388us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100391.781344:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:3.0:1790100391.784007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100391.784097:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109430784 00000100:00100000:0.0:1790100391.784106:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109430784 00000100:00100000:0.0:1790100391.784214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:0.0:1790100391.784223:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:9709:x1877056109430784:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:0.0:1790100391.784243:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100391.784265:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bed expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100391.784347:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790100391.784482:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bed expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.784494:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:0.0:1790100391.784496:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790100391.784500:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bed expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.784517:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530e00, rc 0) 00000100:00100000:0.0:1790100391.784588:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:9709:x1877056109430784:12345-192.168.201.18@tcp:101:rm.0 Request processed in 366us (588us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1790100391.784596:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:0.0:1790100391.788724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100391.788915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109430912 00000100:00100000:2.0:1790100391.788927:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109430912 00000100:00100000:2.0:1790100391.789003:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:2.0:1790100391.789015:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:9709:x1877056109430912:12345-192.168.201.18@tcp:37:rm.0 00000100:00100000:3.0:1790100391.792897:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:9709:x1877056109430912:12345-192.168.201.18@tcp:37:rm.0 Request processed in 3874us (4171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100391.792916:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:3.0:1790100391.797805:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100391.797950:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109431168 00000100:00100000:0.0:1790100391.797961:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109431168 00000100:00100000:0.0:1790100391.798052:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:0.0:1790100391.798060:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d679e038050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:9709:x1877056109431168:12345-192.168.201.18@tcp:35:rm.0 00000100:00100000:0.0:1790100391.798296:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d679e038050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:9709:x1877056109431168:12345-192.168.201.18@tcp:35:rm.0 Request processed in 236us (503us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790100391.798301:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:0.0:1790100391.801470:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100391.801567:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109431424 00000100:00100000:1.0:1790100391.801591:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109431424 00000100:00100000:0.0:1790100391.801819:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1790100391.801831:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:9709:x1877056109431424:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:0.0:1790100391.801856:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100391.801877:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530000/0x31a8f3fdeeefd0bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bf4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.801991:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531000/0x31a8f3fdeeefd0c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.802015:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531000/0x31a8f3fdeeefd0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.802028:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531000/0x31a8f3fdeeefd0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100391.802048:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790100391.802173:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530000/0x31a8f3fdeeefd0bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bf4 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.802192:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531000/0x31a8f3fdeeefd0c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bf4 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.802214:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6787ec1f00) 00010000:00010000:0.0:1790100391.802217:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790100391.802221:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf531000, rc 0) 00000100:00100000:0.0:1790100391.802284:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:9709:x1877056109431424:12345-192.168.201.18@tcp:101:rm.0 Request processed in 455us (820us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790100391.802291:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:1.0:1790100391.805784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100391.805958:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109431552 00000100:00100000:3.0:1790100391.805978:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109431552 00000100:00100000:3.0:1790100391.806111:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:3.0:1790100391.806119:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:9709:x1877056109431552:12345-192.168.201.18@tcp:41:rm.0 00000004:00000024:3.0:1790100391.806171:0:6711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1790100391.806242:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:9709:x1877056109431552:12345-192.168.201.18@tcp:41:rm.0 Request processed in 124us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100391.806251:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:1.0:1790100391.809019:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100391.809148:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109431680 00000100:00100000:0.0:1790100391.809157:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109431680 00000100:00100000:0.0:1790100391.809304:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1790100391.809313:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:9709:x1877056109431680:12345-192.168.201.18@tcp:101:rm.0 00010000:00010000:0.0:1790100391.809331:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100391.809348:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530000/0x31a8f3fdeeefd0d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64bfb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809406:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809417:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809442:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809454:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809458:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809462:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809538:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefd0e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809542:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefd0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809546:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefd0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100391.809579:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790100391.809584:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100391.809604:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefd0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809648:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefd0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809657:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809675:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809682:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809688:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf530c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100391.809692:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809700:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809713:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6787ec1f00) 00010000:00010000:0.0:1790100391.809717:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100391.809722:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809728:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530c00/0x31a8f3fdeeefd0d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809740:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809745:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809751:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809757:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf530200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100391.809766:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809772:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809779:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff8d6787edff00) 00010000:00010000:0.0:1790100391.809782:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100391.809785:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809791:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530200/0x31a8f3fdeeefd0de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809821:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530000/0x31a8f3fdeeefd0d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bfb expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809835:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefd0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bfb expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.809843:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:0.0:1790100391.809845:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100391.809847:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67bf530800, rc 0) 00000100:00100000:0.0:1790100391.809898:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:9709:x1877056109431680:12345-192.168.201.18@tcp:101:rm.0 Request processed in 585us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100391.809903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:1.0:1790100391.812596:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100391.812939:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109431936 00000100:00100000:0.0:1790100391.812948:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109431936 00000100:00100000:0.0:1790100391.813018:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:0.0:1790100391.813030:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:9709:x1877056109431936:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:0.0:1790100391.813095:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790100391.813116:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530800/0x31a8f3fdeeefd0e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bfb expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813132:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd091 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bdf expref: 16 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813139:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:0.0:1790100391.813150:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd0a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64be6 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813155:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6787ec1f00) 00010000:00010000:0.0:1790100391.813157:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100391.813172:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813181:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813188:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813197:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813202:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813206:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813292:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813298:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.813302:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100391.814346:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1790100391.814355:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288383744159ns, next at 289383741929ns, rc = 0 00010000:00010000:0.0:1790100391.814479:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.814492:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.814502:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.814510:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.814517:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.814524:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815007:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100391.815039:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815055:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815061:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815067:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf531200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100391.815072:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815080:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815092:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d6787edfd00) 00010000:00010000:0.0:1790100391.815095:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790100391.815099:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815106:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531200/0x31a8f3fdeeefd0fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815125:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815131:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815137:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815141:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf530400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100391.815150:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815157:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815165:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6787ec1f00) 00010000:00010000:0.0:1790100391.815167:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100391.815171:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.815176:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530400/0x31a8f3fdeeefd0ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100391.815186:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c7938ba reply state 00000000a9047008 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100391.815194:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100391.815293:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:9709:x1877056109431936:12345-192.168.201.18@tcp:36:rm.0 Request processed in 2262us (2702us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790100391.815303:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00010000:00010000:1.0:1790100391.815534:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100391.815542:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.815549:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100391.815552:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.815559:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.815568:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d6787edfd00) 00010000:00010000:1.0:1790100391.815571:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790100391.815575:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.815581:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd101 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100391.815596:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100391.815598:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100391.815600:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100391.817031:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.817044:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.817050:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.817056:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf530e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100391.817060:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.817080:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.817095:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff8d6787edf900) 00010000:00010000:0.0:1790100391.817098:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100391.817102:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100391.817108:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf530e00/0x31a8f3fdeeefd0f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100391.817929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100391.818013:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109432192 00000100:00100000:3.0:1790100391.818025:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109432192 00000100:00100000:3.0:1790100391.818078:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1790100391.818108:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:9709:x1877056109432192:12345-192.168.201.18@tcp:35:rm.0 00000100:00100000:3.0:1790100391.818339:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:9709:x1877056109432192:12345-192.168.201.18@tcp:35:rm.0 Request processed in 231us (412us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790100391.818361:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:1.0:1790100391.821159:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100391.821214:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109432448 00000100:00100000:3.0:1790100391.821225:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109432448 00000100:00100000:3.0:1790100391.821329:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:3.0:1790100391.821342:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:9709:x1877056109432448:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:3.0:1790100391.821418:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790100391.821448:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67bf531000/0x31a8f3fdeeefd0c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bf4 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821469:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bd1 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821480:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6787ec1f00) 00010000:00010000:3.0:1790100391.821495:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd021 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bc3 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821502:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100391.821507:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100391.821531:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821543:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821553:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821573:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821580:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821585:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821862:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821871:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.821879:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100391.822398:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790100391.822420:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822426:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822430:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822434:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100391.822437:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822449:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822456:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:3.0:1790100391.822458:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790100391.822461:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822465:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd116 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822478:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822481:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822485:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822488:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900afe00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100391.822489:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822492:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822496:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1c00) 00010000:00010000:3.0:1790100391.822497:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100391.822499:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.822509:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd108 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100391.822516:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6973460 reply state 00000000ba8eac80 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100391.822522:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100391.822590:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:9709:x1877056109432448:12345-192.168.201.18@tcp:36:rm.0 Request processed in 1250us (1438us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790100391.822596:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00010000:00010000:3.0:1790100391.825688:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.825704:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.825711:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.825716:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100391.825721:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.825728:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.825745:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d6787ec1400) 00010000:00010000:3.0:1790100391.825748:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100391.825752:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100391.825776:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd10f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100392.229878:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100393.253722:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100393.517437:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100393.517475:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100393.517572:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109432704 00000100:00100000:3.0:1790100393.517575:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109432960 00000100:00100000:0.0:1790100393.517584:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109432704 00000100:00100000:3.0:1790100393.517585:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109432960 00000100:00100000:0.0:1790100393.517710:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:2.0:1790100393.517720:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:0.0:1790100393.517726:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109432960:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100393.517728:0:6711:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1790100393.517737:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:2358:x1877056109432704:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100393.517741:0:6711:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1790100393.517814:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109432960:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100393.517824:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00080000:1.0:1790100393.517826:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100393.517948:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:2358:x1877056109432704:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 204us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100393.517957:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:0.0:1790100393.518344:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100393.518380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100393.518423:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109432576 00000100:00100000:3.0:1790100393.518429:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109432832 00000100:00100000:2.0:1790100393.518431:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109432576 00000100:00100000:3.0:1790100393.518436:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109432832 00000100:00100000:2.0:1790100393.518467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 240 00000100:00100000:2.0:1790100393.518477:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109432576:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100393.518492:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:2.0:1790100393.518516:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109432576:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 42us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100393.518523:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 240 00000100:00080000:0.0:1790100393.518526:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100393.518604:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109432832:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100393.521229:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109432832:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 2721us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100393.521241:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000004:00080000:3.0:1790100394.214396:0:8114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 290783781536ns, next at 291783778925ns, rc = 0 00000100:00100000:3.0:1790100394.214586:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126237952:0@lo:400:kworker.0 00000100:00100000:3.0:1790100394.214691:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100394.214762:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100394.214777:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126237824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100394.214812:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100394.214857:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126237952 00000100:00100000:2.0:1790100394.214866:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126237952 00000100:00100000:1.0:1790100394.214868:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126237824 00000100:00100000:1.0:1790100394.214871:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126237824 00000100:00100000:2.0:1790100394.214912:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790100394.214912:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790100394.214919:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126237952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100394.214920:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126237824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100394.214961:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100394.215004:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126237824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100394.215011:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1790100394.215053:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6783505880 x1877056126237824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100394.215071:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126237824:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790100394.215097:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100394.217191:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126238336:0@lo:400:kworker.0 00000100:00100000:1.0:1790100394.217257:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100394.217337:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100394.217344:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126238208:0@lo:400:kworker.0 00000100:00100000:1.0:1790100394.217369:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100394.217399:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126238208 00000100:00100000:1.0:1790100394.217406:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126238208 00000100:00100000:1.0:1790100394.217457:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790100394.217467:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126238208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100394.217528:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126238208:12345-0@lo:400:kworker.0 Request processed in 63us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100394.217534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1790100394.217555:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100394.217585:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126238208:0@lo:400:kworker.0 00000100:00100000:2.0:1790100394.218164:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126237952:12345-0@lo:400:kworker.0 Request processed in 3243us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100394.218174:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790100394.218452:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126237952:0@lo:400:kworker.0 00000100:00100000:3.0:1790100394.218471:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126238464:0@lo:400:kworker.0 00000100:00100000:3.0:1790100394.218560:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100394.218585:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100394.218592:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126238080:0@lo:400:kworker.0 00000100:00100000:3.0:1790100394.218969:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100394.219011:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126238464 00000100:00100000:3.0:1790100394.219017:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126238464 00000100:00100000:3.0:1790100394.219054:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126238080 00000100:00100000:3.0:1790100394.219057:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126238080 00000100:00100000:3.0:1790100394.219076:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790100394.219083:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126238464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100394.219135:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126238464:12345-0@lo:400:kworker.0 Request processed in 52us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100394.219142:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790100394.219324:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790100394.219333:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126238080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100394.219366:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126238080:12345-0@lo:400:kworker.0 Request processed in 34us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100394.219420:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126238336 00000100:00100000:0.0:1790100394.219424:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126238336 00000100:00100000:0.0:1790100394.219454:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790100394.219468:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126238336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100394.219523:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126238336:12345-0@lo:400:kworker.0 Request processed in 56us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100394.219529:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1790100394.219590:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67b5d5fb80 x1877056126238336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100394.219605:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126238336:0@lo:400:kworker.0 00000100:00080000:0.0:1790100394.219650:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100394.219654:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100394.223148:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790100394.223362:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126238080:0@lo:400:kworker.0 00000100:00100000:3.0:1790100394.223378:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126238464:0@lo:400:kworker.0 00010000:00010000:0.0:1790100394.278127:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790100394.956819:0:11616:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1790100395.242367:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126238592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100395.242474:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100395.242693:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126238592 00000100:00100000:2.0:1790100395.242704:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126238592 00000100:00100000:2.0:1790100395.242769:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790100395.242780:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126238592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100395.242825:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100395.253075:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126238592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10215us (10520us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100395.253114:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1790100395.253373:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad198700 x1877056126238592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100395.253403:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126238592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790100395.302118:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790100395.728353:0:11664:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8d7a1360 20000000:00000080:2.0:1790100395.728499:0:11664:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d67b5a30400 uarg=0000000000000000 20000000:01000000:2.0:1790100395.728549:0:11664:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1790100395.728558:0:11664:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1790100395.728564:0:11664:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1790100395.735767:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1790100395.736034:0:11664:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1790100395.746587:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1790100395.746845:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1790100395.746926:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1790100395.746953:0:11664:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790100395.746983:0:11664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747008:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcfbf expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747017:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcfcd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747024:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefcfdb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747035:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bae expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747058:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bb5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747065:0:11664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747266:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bb5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747288:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bb5 expref: 12 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100395.747308:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126238720:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100395.747648:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bae expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747659:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bae expref: 12 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100395.747678:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126238848:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100395.747723:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcfdb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747732:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfdb expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100395.747741:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126238976:0@lo:104: 00000100:00100000:0.0:1790100395.747793:0:11664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100395.747856:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcfcd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747865:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfcd expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100395.747875:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126239104:0@lo:104: 00000100:00100000:0.0:1790100395.747912:0:11664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790100395.747953:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefcfbf expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.747966:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfbf expref: 18 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100395.747975:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126239232:0@lo:104: 00000100:00100000:0.0:1790100395.747998:0:11664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100395.748346:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126238976 00000100:00100000:2.0:1790100395.748364:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126238976 00000100:00100000:2.0:1790100395.748417:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126239104 00000100:00100000:2.0:1790100395.748420:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126239104 00000100:00100000:2.0:1790100395.748439:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790100395.748449:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+4:11664:x1877056126238976:12345-0@lo:104: 00010000:00010000:2.0:1790100395.748469:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100395.748487:0:11664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790100395.748589:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100395.748597:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+4:11664:x1877056126238976:12345-0@lo:104: Request processed in 149us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100395.748603:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790100395.748679:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790100395.748695:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126238976:0@lo:104: 00000100:00100000:2.0:1790100395.748696:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126239232 00000100:00100000:2.0:1790100395.748705:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126239232 00000100:00100000:2.0:1790100395.748729:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100395.748736:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+4:11664:x1877056126239104:12345-0@lo:104: 00010000:00010000:2.0:1790100395.748744:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.748831:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790100395.748840:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+4:11664:x1877056126239104:12345-0@lo:104: Request processed in 102us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100395.748851:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126239104:0@lo:104: 00000100:00100000:2.0:1790100395.748852:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790100395.748987:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790100395.748999:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+3:11664:x1877056126239232:12345-0@lo:104: 00010000:00010000:2.0:1790100395.749007:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749050:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790100395.749055:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44df9276-3139-4fbb-af61-ceba3e95d22a+3:11664:x1877056126239232:12345-0@lo:104: Request processed in 62us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100395.749061:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100395.749112:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126239232:0@lo:104: 00010000:00010000:2.0:1790100395.749120:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790100395.749127:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749137:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae000 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100395.749142:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749152:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100395.749159:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100395.749165:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790100395.749225:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749232:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100395.749256:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749263:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefcfdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcfe2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749281:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100395.749285:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749292:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aee00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100395.749297:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749304:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100395.749310:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100395.749320:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790100395.749334:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749340:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100395.749347:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749367:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67900aee00/0x31a8f3fdeeefcfcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcfd4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749377:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100395.749380:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749385:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780031c00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100395.749388:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749394:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100395.749399:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100395.749403:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790100395.749422:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749428:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100395.749451:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749457:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6780031c00/0x31a8f3fdeeefcfbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefcfc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749472:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100395.749479:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100395.749481:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100395.749499:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100395.749514:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126239360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100395.749551:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100395.749590:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100395.749596:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126239488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100395.749638:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100395.749671:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126239360 00000100:00100000:2.0:1790100395.749676:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126239360 00010000:00010000:2.0:1790100395.749703:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfdb expref: 19 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100395.749724:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126239488 00000100:00100000:2.0:1790100395.749727:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126239488 00010000:00010000:2.0:1790100395.749737:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfcd expref: 20 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100395.749749:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790100395.749755:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+20:3311:x1877056126239360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100395.749766:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100395.749771:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfdb expref: 20 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749779:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfdb expref: 20 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749793:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780031600/0x31a8f3fdeeefcfe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfdb expref: 20 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749819:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100395.749840:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126239616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100395.749856:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126239360:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100395.749865:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790100395.749883:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790100395.749908:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:3311:x1877056126239488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100395.749920:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100395.749926:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100395.749933:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfcd expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749944:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfcd expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749957:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefcfd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfcd expref: 18 pid: 5836 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.749968:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100395.749998:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3311:x1877056126239488:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100395.750004:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790100395.750017:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126239616 00000100:00100000:2.0:1790100395.750020:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126239616 00010000:00010000:2.0:1790100395.750032:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfbf expref: 17 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100395.750044:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100395.750050:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3313:x1877056126239616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100395.750066:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100395.750070:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfbf expref: 17 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.750078:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfbf expref: 17 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.750087:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf531a00/0x31a8f3fdeeefcfc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefcfbf expref: 17 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100395.750096:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100395.750130:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3313:x1877056126239616:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100395.750136:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100395.750196:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126239488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100395.750206:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126239360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100395.750263:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126239616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100395.756954:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100395.756988:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100395.757080:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109433088 00000100:00100000:3.0:1790100395.757093:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109433088 00010000:00010000:3.0:1790100395.757156:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bb5 expref: 13 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100395.757198:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109433216 00000100:00100000:3.0:1790100395.757201:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109433216 00010000:00010000:3.0:1790100395.757215:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bae expref: 14 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100395.757230:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:3.0:1790100395.757257:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+14:2357:x1877056109433088:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100395.757278:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100395.757285:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bb5 expref: 14 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757298:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bb5 expref: 14 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757325:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100395.757392:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+14:2357:x1877056109433088:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 135us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100395.757399:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:3.0:1790100395.757418:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1790100395.757424:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109433216:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100395.757430:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100395.757434:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bae expref: 13 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757442:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bae expref: 13 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757454:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757462:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757480:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757495:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757502:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757510:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757517:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819e00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100395.757523:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757531:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757541:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100395.757552:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100395.757575:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109433216:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 151us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100395.757581:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00010000:00010000:1.0:1790100395.760378:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67900aec00/0x31a8f3fdeeefcff0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bb5 expref: 12 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100395.760409:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126238720:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100395.760526:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf531400/0x31a8f3fdeeefcfe9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64bae expref: 11 pid: 5836 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100395.760538:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1877056126238848:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100395.760581:0:11664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.760653:0:11664:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.760660:0:11664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100395.760667:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd11d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.327224:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790100396.876871:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1790100396.876902:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1790100396.876938:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1790100396.876946:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1790100396.877243:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100396.877272:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126239744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790100396.877368:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100396.877402:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126239744 00000100:00100000:2.0:1790100396.877412:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126239744 00000100:00100000:2.0:1790100396.877488:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100396.877501:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126239744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790100396.877534:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1790100396.877578:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6ab2c3a7, atime: 0x6ab2c3a7, ctime: 0x6ab2c3a7, blocks: 0x1 00010000:00010000:2.0:1790100396.877588:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.877652:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=293s v=(0 0) 00010000:00010000:2.0:1790100396.877658:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100396.877667:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.877688:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.877701:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.877710:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100396.877747:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100396.877911:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100396.877919:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.877928:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781656800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100396.877934:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.877943:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.877964:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.877971:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5d74ad7/0x31a8f3fdeeefd124 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100396.878003:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100396.878005:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100396.878008:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100396.878452:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126239744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 952us (1082us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790100396.878462:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790100396.878796:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1790100396.878834:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d6783505f80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1790100396.878843:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126239744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790100396.973914:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100396.974045:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109433344 00000100:00100000:0.0:1790100396.974061:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109433344 00000100:00100000:0.0:1790100396.974162:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 242 00000100:00100000:0.0:1790100396.974178:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:5596:x1877056109433344:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100396.974205:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100396.974237:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd12b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c02 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.974300:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd12b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c02 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.974313:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd12b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c02 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100396.974350:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819e00, rc 0) 00000100:00100000:0.0:1790100396.974433:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109433344:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 259us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100396.974441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 242 00000100:00100000:3.0:1790100396.989295:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100396.989543:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109433472 00000100:00100000:2.0:1790100396.989557:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109433472 00000100:00100000:2.0:1790100396.989684:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 243 00000100:00100000:2.0:1790100396.989697:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109433472:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100396.990098:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109433472:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 401us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100396.990107:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 243 00000100:00100000:2.0:1790100396.998845:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100397.004759:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109433600 00000100:00100000:1.0:1790100397.004783:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109433600 00000100:00100000:1.0:1790100397.004894:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 244 00000100:00100000:1.0:1790100397.004908:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109433600:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100397.005259:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109433600:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 353us (6430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100397.005268:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 244 00000100:00100000:1.0:1790100397.009055:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100397.009326:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109433728 00000100:00100000:0.0:1790100397.009340:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109433728 00000100:00100000:0.0:1790100397.009415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 245 00000100:00100000:0.0:1790100397.009427:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:9979:x1877056109433728:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100397.010136:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:9979:x1877056109433728:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 707us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.010148:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 245 00000100:00100000:3.0:1790100397.018707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100397.018901:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109433856 00000100:00100000:1.0:1790100397.018913:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109433856 00000100:00100000:1.0:1790100397.018990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 246 00000100:00100000:1.0:1790100397.019013:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:9979:x1877056109433856:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100397.019489:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:9979:x1877056109433856:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 488us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100397.019498:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 246 00000100:00100000:2.0:1790100397.028571:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100397.029278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109433984 00000100:00100000:0.0:1790100397.029294:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109433984 00000100:00100000:0.0:1790100397.029395:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 247 00000100:00100000:0.0:1790100397.029407:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:5596:x1877056109433984:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100397.029428:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100397.029450:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad819600/0x31a8f3fdeeefd132 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c09 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.029489:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad819600/0x31a8f3fdeeefd132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c09 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.029501:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad819600/0x31a8f3fdeeefd132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c09 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.029512:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819600, rc 0) 00000100:00100000:0.0:1790100397.029603:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109433984:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 198us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.029645:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 247 00000100:00100000:0.0:1790100397.045018:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100397.045084:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109434112 00000100:00100000:1.0:1790100397.045096:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109434112 00000100:00100000:1.0:1790100397.045154:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 248 00000100:00100000:1.0:1790100397.045167:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109434112:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100397.045475:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109434112:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 310us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100397.045491:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 248 00000100:00100000:3.0:1790100397.052089:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100397.052203:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109434240 00000100:00100000:1.0:1790100397.052215:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109434240 00000100:00100000:1.0:1790100397.052283:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 249 00000100:00100000:1.0:1790100397.052294:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109434240:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100397.052557:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:5596:x1877056109434240:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 263us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100397.052566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 249 00000100:00100000:2.0:1790100397.058115:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100397.058189:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109434368 00000100:00100000:0.0:1790100397.058201:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109434368 00000100:00100000:0.0:1790100397.058263:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 250 00000100:00100000:0.0:1790100397.058275:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:9982:x1877056109434368:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100397.058587:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:9982:x1877056109434368:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 313us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.058596:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 250 00000100:00100000:0.0:1790100397.065713:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100397.065869:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109434496 00000100:00100000:2.0:1790100397.065887:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109434496 00000100:00100000:2.0:1790100397.066095:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 251 00000100:00100000:2.0:1790100397.066107:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:9982:x1877056109434496:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790100397.066369:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:9982:x1877056109434496:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 264us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100397.066379:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 251 00010000:00010000:2.0:1790100397.349816:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790100397.479293:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100397.479301:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6787677800 from 7 10000000:01000000:0.0:1790100397.479305:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100397.479356:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.479369:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.479381:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100397.479408:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126239872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.479492:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100397.479646:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100397.479833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126239872 00000100:00100000:2.0:1790100397.479842:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126239872 00000100:00100000:2.0:1790100397.479905:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790100397.479916:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+16:5838:x1877056126239872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100397.479931:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100397.479945:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefd140 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefd139 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100397.479970:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefd140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefd139 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100397.479980:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefd140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefd139 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100397.479990:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781656200, rc 0) 00000100:00100000:2.0:1790100397.480043:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126239872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100397.480071:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1790100397.480401:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126239872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100397.480424:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.480435:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100397.480508:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.480540:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100397.480604:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126240000 00000100:00100000:2.0:1790100397.480634:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126240000 00000100:00100000:2.0:1790100397.480670:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790100397.480677:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126240000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100397.480954:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126240000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100397.480961:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1790100397.487189:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100397.487247:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.487319:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.487402:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100397.487442:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100397.487519:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126240128 00000100:00100000:3.0:1790100397.487527:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126240128 00000100:00100000:3.0:1790100397.487589:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1790100397.487598:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126240128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100397.487837:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126240128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100397.487845:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1790100397.488117:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100397.488984:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11679:1877056126240256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100397.489036:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100397.489074:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad960000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100397.489131:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126240256 00000100:00100000:1.0:1790100397.489137:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126240256 00000100:00100000:1.0:1790100397.489180:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1790100397.489188:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:11679:x1877056126240256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100397.489523:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:11679:x1877056126240256:12345-0@lo:502:llog_process_th.0 Request processed in 334us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100397.489530:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1790100397.489725:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11679:1877056126240256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100397.489749:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100397.489758:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100397.489761:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790100397.489767:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6787677800 00000020:00000080:2.0:1790100397.489769:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790100397.489846:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11679:1877056126240384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100397.489895:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100397.489923:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad960000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100397.493115:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126240384 00000100:00100000:1.0:1790100397.493128:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126240384 00000100:00100000:1.0:1790100397.493193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1790100397.493203:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:11679:x1877056126240384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100397.493507:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+17:11679:x1877056126240384:12345-0@lo:502:llog_process_th.0 Request processed in 305us (3611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100397.493515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790100397.493738:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11679:1877056126240384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100397.493772:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100397.493779:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100397.493781:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790100397.493785:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790100397.494040:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790100397.494058:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100397.494069:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100397.494086:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100397.494097:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790100397.494100:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67ad888800 from 7 10000000:01000000:1.0:1790100397.494103:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790100397.494130:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100397.494138:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100397.494147:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100397.494166:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad199c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100397.494197:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100397.494289:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b3ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100397.494338:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126240512 00000100:00100000:2.0:1790100397.494343:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126240512 00000100:00100000:2.0:1790100397.494376:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1790100397.494385:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:5838:x1877056126240512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790100397.494394:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100397.494412:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefd14e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefd147 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100397.494436:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefd14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefd147 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100397.494447:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefd14e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefd147 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100397.494456:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6781656800, rc 0) 00000100:00100000:2.0:1790100397.494507:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126240512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100397.494513:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790100397.494639:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad199c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100397.494651:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.494661:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100397.494710:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.494732:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100397.494742:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100397.494785:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126240640 00000100:00100000:2.0:1790100397.494789:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126240640 00000100:00100000:2.0:1790100397.494874:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1790100397.494882:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126240640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100397.495070:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126240640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100397.495076:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790100397.502141:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.502222:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.502312:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100397.502359:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100397.502387:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126240768 00000100:00100000:0.0:1790100397.502395:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126240768 00000100:00100000:0.0:1790100397.502440:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790100397.502449:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126240768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.503194:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126240768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 743us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.503203:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790100397.503282:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126240768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.503980:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11682:1877056126240896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100397.504038:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100397.504067:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126240896 00000100:00100000:0.0:1790100397.504074:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126240896 00000100:00100000:0.0:1790100397.504101:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790100397.504108:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:11682:x1877056126240896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100397.504286:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:11682:x1877056126240896:12345-0@lo:502:llog_process_th.0 Request processed in 178us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.504302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790100397.504344:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100397.504362:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11682:1877056126240896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100397.504385:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100397.504394:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100397.504397:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790100397.504405:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d67ad888800 00000020:00000080:0.0:1790100397.504408:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790100397.505012:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11682:1877056126241024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100397.505057:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100397.505087:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126241024 00000100:00100000:0.0:1790100397.505092:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126241024 00000100:00100000:0.0:1790100397.505115:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790100397.505123:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:11682:x1877056126241024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100397.505282:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:11682:x1877056126241024:12345-0@lo:502:llog_process_th.0 Request processed in 159us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.505290:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790100397.505324:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100397.505339:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11682:1877056126241024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100397.505360:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100397.505366:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100397.505367:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790100397.505371:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790100397.505428:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790100397.505451:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100397.505462:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.505480:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100397.505491:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790100397.505493:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6788844800 from 7 10000000:01000000:0.0:1790100397.505496:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100397.505523:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.505532:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.505544:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100397.505558:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126241152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.505584:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100397.505599:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100397.505632:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126241152 00000100:00100000:0.0:1790100397.505636:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126241152 00000100:00100000:0.0:1790100397.505654:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790100397.505660:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:5838:x1877056126241152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100397.505670:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100397.505683:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad818c00/0x31a8f3fdeeefd15c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefd155 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.505706:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad818c00/0x31a8f3fdeeefd15c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefd155 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.505728:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad818c00/0x31a8f3fdeeefd15c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefd155 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.505738:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818c00, rc 0) 00000100:00100000:0.0:1790100397.505767:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126241152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.505773:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790100397.505800:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126241152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100397.505812:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.505821:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100397.505859:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126241280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100397.507221:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100397.507294:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100397.507330:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126241280 00000100:00100000:0.0:1790100397.507338:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126241280 00000100:00100000:0.0:1790100397.507413:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1790100397.507422:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126241280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.508021:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787a5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126241280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 598us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.508030:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790100397.508151:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126241280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100397.508206:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126241408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100397.508249:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100397.508310:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678aa26900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100397.508347:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126241408 00000100:00100000:0.0:1790100397.508352:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126241408 00000100:00100000:0.0:1790100397.508414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1790100397.508422:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126241408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100397.508599:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:5838:x1877056126241408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.508608:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1790100397.508698:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44df9276-3139-4fbb-af61-ceba3e95d22a:5838:1877056126241408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100397.508929:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11683:1877056126241536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100397.508974:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100397.509257:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67933c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100397.509293:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126241536 00000100:00100000:1.0:1790100397.509300:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126241536 00000100:00100000:1.0:1790100397.509328:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790100397.509335:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:11683:x1877056126241536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790100397.509915:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:11683:x1877056126241536:12345-0@lo:502:llog_process_th.0 Request processed in 579us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100397.509923:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1790100397.509971:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11683:1877056126241536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100397.513437:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100397.513459:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100397.513799:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790100397.513816:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6788844800 00000020:00000080:2.0:1790100397.513819:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790100397.513957:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11683:1877056126241664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100397.514062:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100397.514111:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678aa26900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100397.514480:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126241664 00000100:00100000:0.0:1790100397.514489:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126241664 00000100:00100000:0.0:1790100397.514542:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1790100397.514551:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:11683:x1877056126241664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100397.514775:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:11683:x1877056126241664:12345-0@lo:502:llog_process_th.0 Request processed in 224us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100397.514783:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1790100397.514901:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44df9276-3139-4fbb-af61-ceba3e95d22a:11683:1877056126241664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100397.514932:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100397.514938:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100397.514940:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790100397.514943:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790100397.515165:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790100397.515196:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100397.515206:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100397.515218:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100397.515744:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790100398.373872:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100398.566355:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790100398.639104:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100398.639209:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100398.639244:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100398.639300:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109434624 00000100:00100000:2.0:1790100398.639311:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109434624 00000100:00100000:2.0:1790100398.639367:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 267 00000100:00100000:2.0:1790100398.639377:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109434624:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100398.639447:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109434624:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 72us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100398.639454:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 267 00000100:00100000:3.0:1790100398.643259:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100398.643370:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109434880 00000100:00100000:2.0:1790100398.643380:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109434880 00000100:00100000:2.0:1790100398.643453:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:2.0:1790100398.643464:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109434880:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100398.643557:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109434880:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 94us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100398.643566:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00080000:3.0:1790100398.649497:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100398.649839:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109434752 00000100:00100000:1.0:1790100398.649859:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109434752 00000100:00080000:3.0:1790100398.649952:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100398.650074:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109435008 00000100:00100000:0.0:1790100398.650080:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109435008 00000100:00100000:0.0:1790100398.650135:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:0.0:1790100398.650146:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109434752:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100398.650236:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109434752:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 91us (11141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100398.650243:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:0.0:1790100398.650261:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:0.0:1790100398.650267:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109435008:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100398.650304:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109435008:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 37us (11059us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100398.650310:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00080000:3.0:1790100398.650689:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100399.334384:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126241920:0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.334468:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100399.334535:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126242432:0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.334562:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100399.334589:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790100399.334595:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126241792:0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.334641:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100399.334660:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126242304:0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.334678:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100399.334859:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126242432 00000100:00100000:2.0:1790100399.334868:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126242432 00000100:00100000:0.0:1790100399.334909:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126242048:0@lo:400:kworker.0 00000100:00100000:2.0:1790100399.334923:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790100399.334934:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126242432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.334942:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100399.334968:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100399.334976:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126242176:0@lo:400:kworker.0 00000100:00100000:2.0:1790100399.334996:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126242432:12345-0@lo:400:kworker.0 Request processed in 64us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100399.335006:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790100399.335009:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100399.335026:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126242176 00000100:00100000:2.0:1790100399.335030:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126242176 00000100:00100000:2.0:1790100399.335050:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790100399.335056:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126242176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.335066:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126241920 00000100:00100000:0.0:1790100399.335072:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126241920 00000100:00100000:2.0:1790100399.335090:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126242176:12345-0@lo:400:kworker.0 Request processed in 32us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100399.335097:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790100399.335106:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126242304 00000100:00100000:0.0:1790100399.335110:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126242304 00000100:00100000:2.0:1790100399.335120:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126241792 00000100:00100000:2.0:1790100399.335124:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126241792 00000100:00100000:0.0:1790100399.335131:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126242048 00000100:00100000:0.0:1790100399.335135:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126242048 00000100:00100000:2.0:1790100399.335156:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790100399.335160:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790100399.335166:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126241792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.335172:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126241920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100399.335199:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126241792:12345-0@lo:400:kworker.0 Request processed in 35us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100399.335206:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1790100399.335221:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126241920:12345-0@lo:400:kworker.0 Request processed in 52us (752us total) trans 0 rc 0/0 00000100:00080000:2.0:1790100399.335234:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100399.335240:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100399.335246:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1790100399.335251:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100399.335267:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790100399.335275:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126242304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100399.335291:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790100399.335302:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126242048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.335310:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126242304:12345-0@lo:400:kworker.0 Request processed in 35us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100399.335317:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790100399.335338:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126242048:12345-0@lo:400:kworker.0 Request processed in 38us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100399.335345:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1790100399.335360:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67b5d5c380 x1877056126242176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100399.335375:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126242176:0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.335386:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126242048:0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.335413:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126241792:0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.335422:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126242304:0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.335442:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126241920:0@lo:400:kworker.0 00000100:00100000:0.0:1790100399.335452:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126242432:0@lo:400:kworker.0 00000100:00100000:3.0:1790100399.336226:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100399.336240:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126242560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100399.336295:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100399.336451:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126242560 00000100:00100000:1.0:1790100399.336458:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126242560 00000100:00100000:1.0:1790100399.336499:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790100399.336508:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1877056126242560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100399.336545:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100399.336592:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1877056126242560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100399.336599:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790100399.337949:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126242560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790100399.397870:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100400.359295:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100400.359321:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126242688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100400.359399:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100400.359560:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126242688 00000100:00100000:1.0:1790100400.359569:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126242688 00000100:00100000:1.0:1790100400.359659:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790100400.359669:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126242688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100400.359707:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100400.359759:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126242688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100400.359766:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1790100400.359927:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad19b100 x1877056126242688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100400.359945:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126242688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790100400.421856:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100401.445919:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790100401.937178:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1790100402.469994:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100403.495279:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100403.758220:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100403.758274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100403.758314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100403.758379:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100403.758646:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109435264 00000100:00100000:1.0:1790100403.758660:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109435264 00000100:00100000:1.0:1790100403.758740:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109435520 00000100:00100000:1.0:1790100403.758744:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109435520 00000100:00100000:1.0:1790100403.758793:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:1.0:1790100403.758804:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109435264:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100403.758912:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109435264:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 109us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100403.758934:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:1.0:1790100403.758954:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:1.0:1790100403.758962:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109435520:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100403.758989:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109435520:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100403.759007:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:2.0:1790100403.759174:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109435392 00000100:00100000:2.0:1790100403.759188:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109435392 00000100:00100000:0.0:1790100403.759256:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109435136 00000100:00100000:0.0:1790100403.759265:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109435136 00000100:00100000:2.0:1790100403.759273:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:2.0:1790100403.759292:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109435392:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100403.759317:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 269 00000100:00100000:0.0:1790100403.759330:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109435136:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:3.0:1790100403.759512:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790100403.759519:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100403.759539:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109435392:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 252us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100403.759549:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1790100403.760336:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109435136:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 1003us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100403.760366:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 269 00000100:00100000:1.0:1790100404.455187:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126242816:0@lo:400:kworker.0 00000100:00100000:1.0:1790100404.455281:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100404.455505:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126242944:0@lo:400:kworker.0 00000100:00100000:0.0:1790100404.455586:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100404.455706:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126242816 00000100:00100000:0.0:1790100404.455717:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126242816 00000100:00100000:1.0:1790100404.455804:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126242944 00000100:00100000:1.0:1790100404.455817:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126242944 00000100:00100000:0.0:1790100404.455822:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1790100404.455884:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790100404.455895:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126242944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100404.456793:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126242944:12345-0@lo:400:kworker.0 Request processed in 897us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100404.456804:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790100404.456867:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126242944:0@lo:400:kworker.0 00000100:00100000:0.0:1790100404.457261:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126242816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100404.457369:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126242816:12345-0@lo:400:kworker.0 Request processed in 1532us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100404.457379:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1790100404.457388:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126243072:0@lo:400:kworker.0 00000100:00100000:2.0:1790100404.457455:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100404.457469:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126243328:0@lo:400:kworker.0 00000100:00100000:2.0:1790100404.457495:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100404.457506:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126243200:0@lo:400:kworker.0 00000100:00100000:0.0:1790100404.457516:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100404.457574:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126242816:0@lo:400:kworker.0 00000100:00100000:2.0:1790100404.457579:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100404.457645:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100404.457657:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126243456:0@lo:400:kworker.0 00000100:00100000:2.0:1790100404.457672:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126243200 00000100:00100000:2.0:1790100404.457682:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126243200 00000100:00100000:0.0:1790100404.457696:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100404.457746:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126243456 00000100:00100000:2.0:1790100404.457766:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126243456 00000100:00100000:0.0:1790100404.457770:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126243072 00000100:00100000:0.0:1790100404.457778:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126243072 00000100:00100000:2.0:1790100404.457796:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790100404.457808:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126243200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100404.457828:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126243328 00000100:00100000:0.0:1790100404.457834:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126243328 00000100:00100000:2.0:1790100404.457874:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126243200:12345-0@lo:400:kworker.0 Request processed in 68us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100404.457887:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790100404.457889:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790100404.457933:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790100404.457941:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126243456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100404.457977:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126243456:12345-0@lo:400:kworker.0 Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100404.457983:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1790100404.457999:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100404.458003:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100404.458005:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790100404.458035:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad4e3480 x1877056126243200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100404.458046:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126243200:0@lo:400:kworker.0 00000100:00100000:2.0:1790100404.458069:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790100404.458076:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126243328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100404.458105:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126243328:12345-0@lo:400:kworker.0 Request processed in 29us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100404.458110:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790100404.458143:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1790100404.458149:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d6783505f80, transno 4294967300 00000100:00100000:2.0:1790100404.458159:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126243456:0@lo:400:kworker.0 00000100:00100000:2.0:1790100404.458169:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126243328:0@lo:400:kworker.0 00000100:00100000:0.0:1790100404.461126:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126243072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100404.461277:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126243072:12345-0@lo:400:kworker.0 Request processed in 3378us (3824us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100404.461288:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790100404.461546:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126243072:0@lo:400:kworker.0 00000100:00100000:2.0:1790100404.461897:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126243584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100404.462049:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100404.462249:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126243584 00000100:00100000:1.0:1790100404.462259:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126243584 00000100:00100000:1.0:1790100404.462426:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790100404.462442:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126243584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100404.462485:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100404.462594:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126243584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100404.462603:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790100404.463011:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126243584:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790100404.517854:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100405.478065:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100405.478096:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126243712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100405.478233:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100405.479075:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126243712 00000100:00100000:2.0:1790100405.479090:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126243712 00000100:00100000:2.0:1790100405.479178:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790100405.479190:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126243712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100405.479258:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100405.479357:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126243712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100405.479365:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1790100405.479687:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad4e1f80 x1877056126243712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100405.479715:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126243712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790100405.542246:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100406.565935:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100407.590066:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100408.615192:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100408.807565:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790100408.880333:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100408.880428:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100408.887845:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100408.887880:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100408.887920:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109435648 00000100:00100000:0.0:1790100408.887931:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109435648 00000100:00100000:0.0:1790100408.887983:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 271 00000100:00100000:0.0:1790100408.887994:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2359:x1877056109435648:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100408.888076:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2359:x1877056109435648:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 83us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100408.888084:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 271 00000100:00100000:3.0:1790100408.888969:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109435904 00000100:00100000:3.0:1790100408.888976:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109435904 00000100:00100000:3.0:1790100408.889043:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:3.0:1790100408.889052:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109435904:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100408.889103:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109435904:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 53us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100408.889109:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00080000:0.0:1790100408.893536:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100408.893622:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109435776 00000100:00100000:1.0:1790100408.893636:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109435776 00000100:00100000:1.0:1790100408.893734:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109436032 00000100:00100000:1.0:1790100408.893738:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109436032 00000100:00100000:1.0:1790100408.893779:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:1.0:1790100408.893790:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109435776:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100408.893870:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109435776:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 82us (13547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100408.893879:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:1.0:1790100408.893895:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:1.0:1790100408.893903:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109436032:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:0.0:1790100408.894049:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100408.894403:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109436032:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 498us (13972us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100408.894411:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:2.0:1790100409.574063:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126243840:0@lo:400:kworker.0 00000100:00100000:2.0:1790100409.574160:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100409.574219:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126244352:0@lo:400:kworker.0 00000100:00100000:2.0:1790100409.574266:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100409.574292:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790100409.574299:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126243968:0@lo:400:kworker.0 00000100:00100000:2.0:1790100409.574334:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100409.574354:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126244480:0@lo:400:kworker.0 00000100:00100000:2.0:1790100409.574377:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100409.574416:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126244480 00000100:00100000:2.0:1790100409.574424:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126244480 00000100:00100000:2.0:1790100409.574484:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790100409.574493:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126244480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100409.574544:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126244480:12345-0@lo:400:kworker.0 Request processed in 52us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100409.574552:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790100409.574573:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126244352 00000100:00100000:2.0:1790100409.574577:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126244352 00000100:00100000:2.0:1790100409.574599:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126243968 00000100:00100000:2.0:1790100409.574601:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126243968 00000100:00100000:2.0:1790100409.574639:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790100409.574646:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126244352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100409.574690:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126244352:12345-0@lo:400:kworker.0 Request processed in 44us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100409.574697:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790100409.574709:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790100409.574715:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126243968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100409.574741:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126243968:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100409.574746:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790100409.574784:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126243968:0@lo:400:kworker.0 00000100:00100000:2.0:1790100409.574794:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126244480:0@lo:400:kworker.0 00000100:00100000:2.0:1790100409.574810:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126244352:0@lo:400:kworker.0 00000100:00100000:1.0:1790100409.574895:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126243840 00000100:00100000:1.0:1790100409.574899:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126243840 00000100:00100000:1.0:1790100409.574934:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1790100409.574941:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126243840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100409.574976:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126243840:12345-0@lo:400:kworker.0 Request processed in 36us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100409.574982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1790100409.575951:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126244224:0@lo:400:kworker.0 00000100:00100000:0.0:1790100409.576027:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100409.576078:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100409.576086:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126244096:0@lo:400:kworker.0 00000100:00100000:0.0:1790100409.576110:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100409.576143:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126244096 00000100:00100000:0.0:1790100409.576150:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126244096 00000100:00100000:1.0:1790100409.576151:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126244224 00000100:00100000:1.0:1790100409.576154:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126244224 00000100:00100000:1.0:1790100409.576191:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790100409.576191:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790100409.576197:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126244096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100409.576198:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126244224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100409.576246:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126244096:12345-0@lo:400:kworker.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100409.576252:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790100409.576254:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126244224:12345-0@lo:400:kworker.0 Request processed in 58us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100409.576266:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1790100409.576274:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100409.576280:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100409.576293:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100409.576316:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126244096:0@lo:400:kworker.0 00010000:00080000:1.0:1790100409.576329:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad199880 x1877056126244224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100409.576339:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126244224:0@lo:400:kworker.0 00000100:00100000:3.0:1790100409.576651:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126244608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100409.576694:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100409.576961:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126243840:0@lo:400:kworker.0 00000100:00100000:0.0:1790100409.577129:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126244608 00000100:00100000:0.0:1790100409.577136:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126244608 00000100:00100000:0.0:1790100409.577180:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790100409.577188:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126244608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100409.577223:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100409.577273:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126244608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100409.577280:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790100409.577392:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126244608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790100409.638001:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100410.598547:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126244736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100410.598665:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100410.598824:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126244736 00000100:00100000:0.0:1790100410.598833:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126244736 00000100:00100000:0.0:1790100410.598884:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790100410.598893:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126244736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100410.598929:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100410.598987:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126244736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100410.598994:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1790100410.599148:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad4e1500 x1877056126244736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100410.599168:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126244736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790100410.661779:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100411.685868:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100412.709774:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100413.733989:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100413.998020:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100413.998156:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109436160 00000100:00100000:0.0:1790100413.998167:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109436160 00000100:00100000:0.0:1790100413.998228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 273 00000100:00100000:0.0:1790100413.998238:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109436160:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100413.998324:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109436160:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100413.998332:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 273 00000100:00100000:3.0:1790100413.999086:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100413.999163:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109436288 00000100:00100000:2.0:1790100413.999168:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109436288 00000100:00100000:2.0:1790100413.999227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:2.0:1790100413.999235:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109436288:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100413.999287:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109436288:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100413.999294:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00080000:0.0:1790100413.999409:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100414.009422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100414.009523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100414.009655:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109436416 00000100:00100000:1.0:1790100414.009671:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109436416 00000100:00100000:0.0:1790100414.009792:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109436544 00000100:00100000:0.0:1790100414.009796:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109436544 00000100:00100000:1.0:1790100414.009903:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:1.0:1790100414.009915:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2356:x1877056109436416:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:1.0:1790100414.009950:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefd098 00000100:00080000:1.0:1790100414.009961:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8d67ad05c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100414.010001:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1790100414.010198:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100414.013198:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+2:2356:x1877056109436416:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 3274us (3775us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100414.013230:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00080000:2.0:1790100414.016213:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100414.016224:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100414.017964:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:0.0:1790100414.017982:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109436544:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100414.018080:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109436544:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 105us (8557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100414.018089:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:2.0:1790100414.694006:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126244864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100414.694088:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100414.694262:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126244864 00000100:00100000:0.0:1790100414.694271:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126244864 00000100:00100000:0.0:1790100414.694343:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790100414.694353:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126244864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100414.694388:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790100414.694571:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100414.698248:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126244864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3884us (4147us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100414.698265:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790100414.698338:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126244992:0@lo:400:kworker.0 00000100:00100000:0.0:1790100414.698409:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100414.698549:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126244992 00000100:00100000:3.0:1790100414.698559:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126244992 00000100:00100000:3.0:1790100414.698633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1790100414.698643:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126244992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100414.698698:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126244992:12345-0@lo:400:kworker.0 Request processed in 56us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100414.698704:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1790100414.699218:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126244992:0@lo:400:kworker.0 00000100:00100000:2.0:1790100414.699340:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126244864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100414.699731:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126245248:0@lo:400:kworker.0 00000100:00100000:0.0:1790100414.699777:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100414.699820:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100414.699827:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126245120:0@lo:400:kworker.0 00000100:00100000:0.0:1790100414.699859:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100414.699883:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126245504:0@lo:400:kworker.0 00000100:00100000:0.0:1790100414.699904:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100414.699921:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100414.699926:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126245376:0@lo:400:kworker.0 00000100:00100000:0.0:1790100414.699966:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100414.700217:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126245248 00000100:00100000:2.0:1790100414.700225:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126245248 00000100:00100000:2.0:1790100414.700288:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126245120 00000100:00100000:2.0:1790100414.700292:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126245120 00000100:00100000:2.0:1790100414.700314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126245504 00000100:00100000:2.0:1790100414.700316:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126245504 00000100:00100000:2.0:1790100414.700333:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790100414.700340:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126245248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100414.700402:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126245248:12345-0@lo:400:kworker.0 Request processed in 62us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100414.700409:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790100414.700428:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790100414.700435:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126245120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100414.700461:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126245120:12345-0@lo:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100414.700466:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790100414.700477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790100414.700483:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126245504:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790100414.700605:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100414.700658:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126245376 00000100:00100000:3.0:1790100414.700662:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126245376 00000100:00100000:3.0:1790100414.700702:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100414.700709:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126245376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100414.700752:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126245376:12345-0@lo:400:kworker.0 Request processed in 45us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100414.700759:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1790100414.700779:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100414.700962:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126245120:0@lo:400:kworker.0 00000100:00100000:3.0:1790100414.700981:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126245248:0@lo:400:kworker.0 00000100:00100000:2.0:1790100414.701059:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126245504:12345-0@lo:400:kworker.0 Request processed in 576us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100414.701065:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1790100414.701248:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad19b480 x1877056126245376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100414.701261:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126245376:0@lo:400:kworker.0 00000100:00100000:0.0:1790100414.701272:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126245504:0@lo:400:kworker.0 00010000:00010000:2.0:1790100414.757894:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100415.718038:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126245632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100415.718135:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100415.718361:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126245632 00000100:00100000:2.0:1790100415.718372:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126245632 00000100:00100000:2.0:1790100415.718436:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790100415.718447:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126245632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100415.718485:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100415.718542:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126245632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100415.718550:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1790100415.718698:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87c380 x1877056126245632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100415.718717:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126245632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100415.782014:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100416.805926:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790100417.317903:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:2.0:1790100417.317914:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d67ad05a000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:1.0:1790100417.318041:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67ad05a000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c for lustre-OST0001 00000020:00000080:1.0:1790100417.318091:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67ad05c000 for lustre-OST0001 00010000:00010000:0.0:1790100417.838425:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790100418.026907:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790100418.854320:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100419.119680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100419.119771:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100419.119786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100419.119837:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109436672 00000100:00100000:0.0:1790100419.119847:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109436672 00000100:00100000:0.0:1790100419.119892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 275 00000100:00100000:0.0:1790100419.119903:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109436672:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100419.119974:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109436672:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100419.119980:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 275 00000100:00100000:3.0:1790100419.120514:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109436800 00000100:00100000:3.0:1790100419.120519:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109436800 00000100:00100000:3.0:1790100419.120591:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109436928 00000100:00100000:3.0:1790100419.120594:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109436928 00000100:00100000:2.0:1790100419.120642:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:2.0:1790100419.120653:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109436800:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100419.121055:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109436800:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 43us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100419.121063:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00080000:1.0:1790100419.121118:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100419.121285:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:3.0:1790100419.121292:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109436928:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100419.121327:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109436928:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 36us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100419.121331:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 107 00000001:02000400:0.0:1790100419.495294:0:11849:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:06:57 (1790100417) 00000100:00100000:2.0:1790100419.814439:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100419.814465:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126245760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100419.814541:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100419.814654:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126245760 00000100:00100000:3.0:1790100419.814662:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126245760 00000100:00100000:3.0:1790100419.814723:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790100419.814734:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126245760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100419.814779:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100419.814826:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126245760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100419.814834:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1790100419.816402:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100419.816461:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126245760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100419.818922:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126245888:0@lo:400:kworker.0 00000100:00100000:3.0:1790100419.819003:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100419.819092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126245888 00000100:00100000:1.0:1790100419.819102:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126245888 00000100:00100000:1.0:1790100419.819154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1790100419.819164:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126245888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100419.819563:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126245888:12345-0@lo:400:kworker.0 Request processed in 400us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100419.819572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1790100419.819650:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126246016:0@lo:400:kworker.0 00000100:00100000:1.0:1790100419.819679:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100419.819718:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126246016 00000100:00100000:1.0:1790100419.819723:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126246016 00000100:00100000:1.0:1790100419.819752:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790100419.819759:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126246016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100419.819798:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126246016:12345-0@lo:400:kworker.0 Request processed in 39us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100419.819803:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790100419.819839:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126246016:0@lo:400:kworker.0 00000100:00100000:3.0:1790100419.819923:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126245888:0@lo:400:kworker.0 00000100:00100000:3.0:1790100419.820150:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126246144:0@lo:400:kworker.0 00000100:00100000:3.0:1790100419.820179:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100419.820250:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126246144 00000100:00100000:1.0:1790100419.820255:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126246144 00000100:00100000:1.0:1790100419.820659:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790100419.820668:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126246144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100419.820919:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126246144:12345-0@lo:400:kworker.0 Request processed in 251us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100419.820926:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790100419.820958:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126246272:0@lo:400:kworker.0 00000100:00100000:1.0:1790100419.820987:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100419.821015:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126246272 00000100:00100000:1.0:1790100419.821019:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126246272 00000100:00100000:1.0:1790100419.821047:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790100419.821053:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126246272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100419.821083:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126246272:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100419.821088:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1790100419.821113:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67ad87c380 x1877056126246272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790100435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100419.821124:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126246272:0@lo:400:kworker.0 00000100:00080000:1.0:1790100419.821139:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100419.821143:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100419.821384:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100419.821395:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126246400:0@lo:400:kworker.0 00000100:00100000:2.0:1790100419.821424:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100419.821450:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126246400 00000100:00100000:2.0:1790100419.821454:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126246400 00000100:00100000:2.0:1790100419.821482:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790100419.821499:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126246400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100419.821535:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126246400:12345-0@lo:400:kworker.0 Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100419.821541:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790100419.821568:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126246400:0@lo:400:kworker.0 00000100:00080000:2.0:1790100419.821584:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100419.821730:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126246144:0@lo:400:kworker.0 00010000:00010000:0.0:1790100419.877991:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100420.662666:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100420.662776:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109437056 00000100:00100000:1.0:1790100420.662788:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109437056 00000100:00100000:1.0:1790100420.662912:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:1.0:1790100420.662925:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:10251:x1877056109437056:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100420.662945:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100420.662966:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c10 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.663026:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd16a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.663048:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.663058:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100420.663089:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790100420.663091:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100420.663120:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.663138:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c10 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.663151:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd16a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c10 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.663157:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6799df4e00) 00010000:00010000:1.0:1790100420.663160:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100420.663163:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13600, rc 0) 00000100:00100000:1.0:1790100420.663215:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:10251:x1877056109437056:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 294us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100420.663222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:2.0:1790100420.675064:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100420.675463:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109437184 00000100:00100000:1.0:1790100420.675493:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109437184 00000100:00100000:1.0:1790100420.675565:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:1.0:1790100420.675577:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:10252:x1877056109437184:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100420.675607:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100420.675663:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c17 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.675746:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.675763:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.675777:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.675793:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.675800:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.675806:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676027:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12200/0x31a8f3fdeeefd186 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676036:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12200/0x31a8f3fdeeefd186 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676043:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12200/0x31a8f3fdeeefd186 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100420.676071:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790100420.676075:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100420.676095:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12200/0x31a8f3fdeeefd186 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676112:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676119:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676125:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676130:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100420.676135:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676142:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676155:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6799df4e00) 00010000:00010000:1.0:1790100420.676158:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100420.676162:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676169:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676179:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676185:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676191:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676201:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100420.676204:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676210:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676217:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d6799df4a00) 00010000:00010000:1.0:1790100420.676219:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100420.676222:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676228:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd17f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676259:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c17 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676274:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12200/0x31a8f3fdeeefd186 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c17 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100420.676281:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d6799df4500) 00010000:00010000:1.0:1790100420.676283:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100420.676286:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12200, rc 0) 00000100:00100000:1.0:1790100420.676352:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:10252:x1877056109437184:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 777us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100420.676360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1790100420.680448:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100420.680794:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109437440 00000100:00100000:2.0:1790100420.680806:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109437440 00000100:00100000:2.0:1790100420.680888:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:2.0:1790100420.680897:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:10252:x1877056109437440:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100420.680920:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100420.680940:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657600/0x31a8f3fdeeefd18d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c1e expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.681024:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.681042:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.681056:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.681131:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.681137:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.681142:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.681877:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142e00/0x31a8f3fdeeefd1a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.681891:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142e00/0x31a8f3fdeeefd1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.681910:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142e00/0x31a8f3fdeeefd1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100420.681923:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790100420.682087:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682096:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682103:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682110:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781657800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100420.682114:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682122:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682135:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d6799df4500) 00010000:00010000:2.0:1790100420.682138:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100420.682143:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682150:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657800/0x31a8f3fdeeefd194 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682163:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682169:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682182:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682187:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100420.682190:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682197:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682206:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d6787defb00) 00010000:00010000:2.0:1790100420.682209:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100420.682211:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.682218:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd19b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.683117:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6781657600/0x31a8f3fdeeefd18d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c1e expref: 10 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.683137:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142e00/0x31a8f3fdeeefd1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c1e expref: 9 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100420.683144:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:2.0:1790100420.683147:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100420.683150:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142e00, rc 0) 00000100:00100000:2.0:1790100420.683300:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:10252:x1877056109437440:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 2402us (2865us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790100420.683320:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:0.0:1790100420.692975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100420.693152:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109437568 00000100:00100000:1.0:1790100420.693178:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109437568 00000100:00100000:1.0:1790100420.693241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:1.0:1790100420.693252:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:10252:x1877056109437568:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790100420.693375:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:10252:x1877056109437568:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 Request processed in 122us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100420.693382:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:2.0:1790100420.838000:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100420.838025:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126246528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100420.838100:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100420.838185:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126246528 00000100:00100000:2.0:1790100420.838193:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126246528 00000100:00100000:2.0:1790100420.838240:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790100420.838248:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126246528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100420.838284:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100420.838345:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126246528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100420.838352:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1790100420.838891:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6784e41f80 x1877056126246528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100420.838913:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126246528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100420.903398:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100421.098319:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790100421.926558:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790100422.428287:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:0.0:1790100422.685000:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100422.685096:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109437696 00000100:00100000:2.0:1790100422.685110:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109437696 00000100:00100000:2.0:1790100422.685215:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:2.0:1790100422.685229:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:10294:x1877056109437696:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100422.685258:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100422.685289:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c25 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790100422.685390:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790100422.685398:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685417:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685435:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685483:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685492:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685498:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685806:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685815:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685823:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685830:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100422.685834:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685842:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685858:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6799df4e00) 00010000:00010000:2.0:1790100422.685862:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100422.685868:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685874:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd1b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685891:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685898:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685904:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685908:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100422.685911:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685916:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685924:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d6787defb00) 00010000:00010000:2.0:1790100422.685927:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100422.685930:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685936:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685980:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c25 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.685990:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6799df4e00) 00010000:00010000:2.0:1790100422.685993:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100422.686002:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c25 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.686025:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142600, rc 0) 00000100:00100000:2.0:1790100422.686099:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:10294:x1877056109437696:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 873us (1116us total) trans 0 rc 301/301 00000100:00100000:2.0:1790100422.686107:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:3.0:1790100422.701331:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100422.701459:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109437952 00000100:00100000:2.0:1790100422.701472:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109437952 00000100:00100000:2.0:1790100422.701538:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:2.0:1790100422.701551:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:10294:x1877056109437952:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:2.0:1790100422.701656:0:11548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100422.701693:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd16a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c10 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.701718:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6799df4e00) 00010000:00010000:2.0:1790100422.701733:0:11548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100422.702035:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.702047:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.702056:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.702065:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.702070:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100422.702081:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100422.703167:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790100422.703184:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.703193:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.703208:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.703214:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100422.703220:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.703228:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.703239:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787defb00) 00010000:00010000:0.0:1790100422.703242:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100422.703247:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.703253:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd1c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100422.703270:0:11548:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000161efa06 reply state 0000000018f96430 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100422.703281:0:11548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100422.703438:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:10294:x1877056109437952:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 1884us (2114us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790100422.703459:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00010000:00010000:1.0:1790100422.712502:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.712522:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.712533:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.712541:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100422.712548:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.712559:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.712582:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d6787def100) 00010000:00010000:1.0:1790100422.712587:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100422.712601:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.712639:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd1cc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100422.803012:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100422.803154:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109438080 00000100:00100000:3.0:1790100422.803168:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109438080 00000100:00100000:3.0:1790100422.803367:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:3.0:1790100422.803380:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:10302:x1877056109438080:12345-192.168.201.18@tcp:101:lctl.0 00010000:00010000:3.0:1790100422.803412:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100422.803451:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd1d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c2c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.803541:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd1da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.803560:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd1da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.803588:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd1da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100422.803884:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790100422.803889:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100422.803938:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd1da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.803970:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd1d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c2c expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.803989:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd1da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c2c expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.803998:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1b00) 00010000:00010000:3.0:1790100422.804001:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100422.804006:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae200, rc 0) 00000100:00100000:3.0:1790100422.804077:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:10302:x1877056109438080:12345-192.168.201.18@tcp:101:lctl.0 Request processed in 700us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.804085:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:0.0:1790100422.895977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100422.896159:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109438208 00000100:00100000:1.0:1790100422.896172:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109438208 00000100:00100000:1.0:1790100422.896254:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:1.0:1790100422.896267:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:10308:x1877056109438208:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1790100422.896296:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100422.896326:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd1e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c33 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896421:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896448:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896463:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896482:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896488:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896495:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896700:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefd1f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896707:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefd1f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896712:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefd1f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100422.896744:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790100422.896748:0:6711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100422.896797:0:6711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefd1f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896809:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896814:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896819:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896823:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100422.896827:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896832:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896841:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1b00) 00010000:00010000:1.0:1790100422.896848:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100422.896853:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896858:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd1e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896869:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896873:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896877:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896880:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100422.896882:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896885:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896889:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d6799df4400) 00010000:00010000:1.0:1790100422.896890:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100422.896891:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896894:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd1ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896923:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefd1e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c33 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896942:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefd1f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c33 expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.896947:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:1.0:1790100422.896949:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790100422.896950:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13400, rc 0) 00000100:00100000:1.0:1790100422.897113:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:10308:x1877056109438208:12345-192.168.201.18@tcp:101:bash.0 Request processed in 847us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100422.897121:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:2.0:1790100422.899676:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100422.899862:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109438464 00000100:00100000:0.0:1790100422.899875:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109438464 00000100:00100000:0.0:1790100422.899985:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:0.0:1790100422.899997:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:10308:x1877056109438464:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1790100422.900050:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100422.900074:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd1fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c3a expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.900225:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.900243:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.900257:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.900415:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.900718:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.900949:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790100422.901603:0:11548:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1790100422.901949:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.901967:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.901978:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.902099:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.902108:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.902116:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.902122:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100422.902127:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.902147:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.902162:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:1.0:1790100422.902165:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100422.902169:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.902176:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd204 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100422.902195:0:11548:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5b7c669 reply state 00000000716271b9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100422.902204:0:11548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790100422.902244:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd1fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c3a expref: 13 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.902259:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c3a expref: 12 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.902267:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100422.902270:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100422.902272:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12e00, rc 0) 00000100:00100000:1.0:1790100422.903855:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:10308:x1877056109438464:12345-192.168.201.18@tcp:101:bash.0 Request processed in 3846us (4176us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790100422.903871:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00010000:00010000:1.0:1790100422.907158:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.907200:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.907209:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.907216:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100422.907222:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.907231:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.907252:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787edf000) 00010000:00010000:1.0:1790100422.907255:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100422.907260:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.907264:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd20b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100422.907825:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100422.907919:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109438592 00000100:00100000:3.0:1790100422.907930:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109438592 00000100:00100000:3.0:1790100422.908026:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1790100422.908034:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1877056109438592:12345-192.168.201.18@tcp:8:bash.0 00010000:00080000:3.0:1790100422.908068:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:3.0:1790100422.908116:0:6687:0:(genops.c:1384:class_connect()) connect: client dd2cd87b-6ca1-4323-9b74-fad785d94e6c, cookie 0x31a8f3fdeeefd220 00002000:00100000:3.0:1790100422.908129:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd2cd87b-6ca1-4323-9b74-fad785d94e6c/ffff8d67b5a26000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790100422.908165:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790100422.908456:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790100422.908496:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d67b5a27000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100422.908673:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2356:x1877056109438592:12345-192.168.201.18@tcp:8:bash.0 Request processed in 637us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.908682:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1790100422.912052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100422.912397:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109438720 00000100:00100000:1.0:1790100422.912410:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109438720 00000100:00100000:1.0:1790100422.912546:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:1.0:1790100422.912557:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:0:x1877056109438720:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1790100422.912579:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100422.912606:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c41 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100422.912694:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790100422.912716:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1790100422.912720:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100422.912729:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c41 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.912746:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c41 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100422.912759:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13a00, rc 0) 00000100:00100000:1.0:1790100422.912821:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:0:x1877056109438720:12345-192.168.201.18@tcp:101:bash.0 Request processed in 267us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100422.912826:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00080000:3.0:1790100422.912878:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100422.917496:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100422.917584:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109438848 00000100:00100000:3.0:1790100422.917598:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109438848 00000100:00100000:3.0:1790100422.917827:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:3.0:1790100422.917848:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:10308:x1877056109438848:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1790100422.917875:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100422.918072:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c48 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.918145:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c41 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.918155:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100422.918160:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100422.918166:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.918207:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c41 expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.918238:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c41 expref: 8 pid: 6689 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100422.918254:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1877056126246656:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100422.918377:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b900 going to sleep for 11 seconds 00000100:00100000:3.0:1790100422.920831:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1877056126246656:192.168.201.18@tcp:104: 00000100:00100000:2.0:1790100422.920881:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:3.0:1790100422.920898:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.920923:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900afe00, rc 0) 00000100:00100000:3.0:1790100422.921004:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:10308:x1877056109438848:12345-192.168.201.18@tcp:101:bash.0 Request processed in 3166us (3522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100422.921014:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:0.0:1790100422.922074:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109438976 00000100:00100000:0.0:1790100422.922090:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109438976 00010000:00010000:0.0:1790100422.922146:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c41 expref: 8 pid: 6689 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100422.922201:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:0.0:1790100422.922213:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109438976:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100422.922243:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100422.922265:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c41 expref: 8 pid: 6689 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.922285:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c41 expref: 8 pid: 6689 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.922313:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd227 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c41 expref: 8 pid: 6689 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.922333:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100422.922337:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100422.922346:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.922356:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100422.922394:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100422.922409:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785128380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1877056126246784:192.168.201.18@tcp:105: 00000100:00100000:0.0:1790100422.925224:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6783489f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100422.928114:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100422.928325:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785128380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5828:1877056126246784:192.168.201.18@tcp:105: 00010000:00010000:0.0:1790100422.928355:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100422.928460:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109438976:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 6249us (7579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100422.928473:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:3.0:1790100422.928799:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109439232 00000100:00100000:3.0:1790100422.928813:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109439232 00000100:00100000:3.0:1790100422.928910:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1790100422.928922:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:10308:x1877056109439232:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:3.0:1790100422.929510:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:10308:x1877056109439232:12345-192.168.201.18@tcp:35:bash.0 Request processed in 589us (1409us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790100422.929517:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00010000:00010000:3.0:1790100422.951302:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100422.998796:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100422.999157:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109439488 00000100:00100000:3.0:1790100422.999171:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109439488 00000100:00100000:3.0:1790100422.999264:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:3.0:1790100422.999274:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:10318:x1877056109439488:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100422.999307:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100422.999337:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd235 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100422.999466:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790100422.999632:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd235 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c4f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.999647:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1b00) 00010000:00010000:3.0:1790100422.999649:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100422.999654:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd235 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c4f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100422.999666:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af400, rc 0) 00000100:00100000:3.0:1790100423.000198:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:10318:x1877056109439488:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 921us (1415us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1790100423.000206:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:2.0:1790100423.005378:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.005537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109439744 00000100:00100000:3.0:1790100423.005550:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109439744 00000100:00100000:3.0:1790100423.005686:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1790100423.005699:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:10318:x1877056109439744:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100423.006066:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:10318:x1877056109439744:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 368us (701us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1790100423.006075:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1790100423.072575:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.073138:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109439872 00000100:00100000:0.0:1790100423.073154:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109439872 00000100:00100000:0.0:1790100423.073250:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:0.0:1790100423.073264:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:10324:x1877056109439872:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100423.073369:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100423.073400:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c56 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.073512:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd24a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.073532:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.073548:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100423.073603:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790100423.073608:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100423.073682:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.073720:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c56 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.073747:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd24a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c56 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.073781:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100423.073785:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100423.073789:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818000, rc 0) 00000100:00100000:0.0:1790100423.073878:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:10324:x1877056109439872:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 617us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100423.073887:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:2.0:1790100423.080721:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100423.081233:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109440128 00000100:00100000:1.0:1790100423.081248:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109440128 00000100:00100000:1.0:1790100423.081339:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:1.0:1790100423.081352:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:10324:x1877056109440128:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100423.081383:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100423.081412:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd251 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c5d expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.081869:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefd258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.081892:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefd258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.081930:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefd258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100423.081950:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790100423.082302:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd251 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c5d expref: 19 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.082328:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefd258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c5d expref: 18 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.082339:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100423.082343:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100423.082347:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12800, rc 0) 00000100:00100000:1.0:1790100423.082455:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:10324:x1877056109440128:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1104us (1749us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1790100423.082465:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:1.0:1790100423.089526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100423.090881:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.090996:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109440512 00000100:00100000:3.0:1790100423.091031:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109440512 00000100:00100000:3.0:1790100423.091132:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1790100423.091145:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:2359:x1877056109440512:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100423.091165:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100423.091196:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefd258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c5d expref: 18 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.091221:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:3.0:1790100423.091227:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100423.091316:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:2359:x1877056109440512:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 173us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100423.091324:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:0.0:1790100423.094512:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109440384 00000100:00100000:0.0:1790100423.094536:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109440384 00000100:00100000:0.0:1790100423.094893:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:0.0:1790100423.094908:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:10324:x1877056109440384:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100423.094946:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100423.094987:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd266 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c64 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.095146:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd26d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.095166:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.095180:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100423.095196:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790100423.095402:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd266 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c64 expref: 20 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.095469:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd26d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c64 expref: 19 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.095478:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:0.0:1790100423.095481:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790100423.095485:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819000, rc 0) 00000100:00100000:0.0:1790100423.095591:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:10324:x1877056109440384:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 686us (6082us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790100423.095599:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:2.0:1790100423.100897:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100423.101270:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109440640 00000100:00100000:1.0:1790100423.101351:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109440640 00000100:00100000:1.0:1790100423.101481:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:1.0:1790100423.101494:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2357:x1877056109440640:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:1.0:1790100423.101569:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.101596:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.101687:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100423.101693:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100423.101698:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.101744:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.101760:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 7 pid: 6687 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100423.101777:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877056126246912:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100423.101900:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f82480 going to sleep for 11 seconds 00000100:00100000:1.0:1790100423.104902:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877056126246912:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100423.104947:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100423.106680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.106964:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109440768 00000100:00100000:0.0:1790100423.106975:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109440768 00002000:00100000:0.0:1790100423.107039:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8d6787deb480 x1877056109440768/t0(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:719/0 lens 504/0 e 0 to 0 dl 1790100434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790100423.107050:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6787deb480 with x1877056109440768 ext(0->12) 00010000:00010000:0.0:1790100423.107061:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 8 pid: 6687 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.107080:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 8 pid: 6687 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100423.107090:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d6787deb480 00000100:00100000:0.0:1790100423.107128:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1790100423.107138:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109440768:12345-192.168.201.18@tcp:4:lfs.0 00000001:00100000:3.0:1790100423.173844:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000100:00100000:3.0:1790100423.179217:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2358:x1877056109440768:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 72062us (72598us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790100423.179245:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00002000:00100000:3.0:1790100423.179262:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8d6787deb480 x1877056109440768/t4294967299(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:719/0 lens 504/448 e 0 to 0 dl 1790100434 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790100423.179274:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6787deb480 with x1877056109440768 ext(0->12) 00010000:00010000:3.0:1790100423.179288:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 9 pid: 6687 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.179391:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 9 pid: 6687 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100423.179402:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d6787deb480 00000100:00100000:2.0:1790100423.184371:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.184489:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109440896 00000100:00100000:3.0:1790100423.184503:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109440896 00010000:00010000:3.0:1790100423.184688:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 9 pid: 6687 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100423.184874:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:2.0:1790100423.184889:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2357:x1877056109440896:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100423.184909:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790100423.184935:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790100423.184939:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790100422 00002000:00010000:2.0:1790100423.184942:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790100422 00002000:00010000:2.0:1790100423.184944:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790100422 00010000:00010000:2.0:1790100423.184952:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 9 pid: 6687 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.185002:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 9 pid: 6687 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.185034:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1c2df8d/0x31a8f3fdeeefd22e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c48 expref: 9 pid: 6687 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.185058:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100423.185064:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100423.185071:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.185083:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.185121:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100423.185189:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109440896:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 304us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100423.185198:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00010000:00010000:1.0:1790100423.186633:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.186657:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.186714:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.186975:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.186985:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.186994:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100423.187000:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.187011:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.187033:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.187041:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e556af1c/0x31a8f3fdeeefd27b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100423.187155:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2357:x1877056109440640:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 85659us (86266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100423.187166:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1790100423.197805:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.197892:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109441152 00000100:00100000:0.0:1790100423.197929:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109441152 00000100:00100000:0.0:1790100423.198018:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1790100423.198031:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:10324:x1877056109441152:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:0.0:1790100423.198119:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd26d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c64 expref: 19 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100423.198528:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1790100423.199057:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1790100423.200376:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1790100423.200477:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.200501:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c3a expref: 23 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.200511:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.200664:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c3a expref: 23 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.200862:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c3a expref: 23 pid: 11548 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100423.200882:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1877056126247040:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100423.201094:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100423.212897:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1877056126247040:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100423.212939:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100423.217481:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.217664:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109441280 00000100:00100000:0.0:1790100423.217683:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109441280 00010000:00010000:0.0:1790100423.217740:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c3a expref: 24 pid: 11548 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100423.217789:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:0.0:1790100423.217800:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:2357:x1877056109441280:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100423.217818:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100423.217826:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c3a expref: 24 pid: 11548 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.217841:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c3a expref: 24 pid: 11548 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.217868:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c3a expref: 24 pid: 11548 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.217890:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:0.0:1790100423.217896:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.217923:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.217932:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.218377:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.218402:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100423.218635:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1790100423.218916:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1790100423.219234:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126247168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790100423.219328:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100423.219372:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b480 going to sleep for 11 seconds 00010000:00010000:0.0:1790100423.219506:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100423.219698:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+25:2357:x1877056109441280:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1896us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100423.219712:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1790100423.220097:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126247168 00000100:00100000:1.0:1790100423.220109:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126247168 00000100:00100000:1.0:1790100423.220187:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100423.220226:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877056126247168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790100423.220383:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877056126247168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 170us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100423.220392:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790100423.221302:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100423.222339:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126247168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790100423.231016:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1790100423.231366:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126247296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790100423.231471:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100423.231607:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100423.231785:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126247296 00000100:00100000:1.0:1790100423.231795:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126247296 00000100:00100000:1.0:1790100423.231890:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100423.231902:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1877056126247296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790100423.232224:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1877056126247296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 324us (753us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790100423.232233:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100423.232362:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126247296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790100423.232455:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1790100423.232507:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.232520:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.232529:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.232536:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100423.232541:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.232549:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.232569:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:0.0:1790100423.232590:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790100423.232596:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.232602:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd282 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790100423.232865:0:5844:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790100423.233134:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1790100423.233145:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319802534054ns, next at 320802532217ns, rc = 0 00000001:00080000:0.0:1790100423.233153:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1790100423.233192:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:0.0:1790100423.233195:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790100423.233204:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd26d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c64 expref: 27 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100423.233336:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:10324:x1877056109441152:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 35307us (35547us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1790100423.233345:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000020:00080000:0.0:1790100423.233350:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790100423.236909:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.237011:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109441408 00000100:00100000:3.0:1790100423.237024:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109441408 00000100:00100000:3.0:1790100423.237104:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:3.0:1790100423.237117:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:10324:x1877056109441408:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100423.237150:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100423.237182:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd289 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c6b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.237265:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd289 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c6b expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.237284:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd289 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c6b expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.237340:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100423.237345:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100423.237362:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900aea00, rc 0) 00000100:00100000:3.0:1790100423.237494:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:10324:x1877056109441408:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 378us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100423.237502:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:2.0:1790100423.242692:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.243139:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109441664 00000100:00100000:3.0:1790100423.243153:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109441664 00000100:00100000:3.0:1790100423.243227:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1790100423.243238:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d679e039450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:10324:x1877056109441664:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100423.243723:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d679e039450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:10324:x1877056109441664:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 484us (1055us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1790100423.243732:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1790100423.323658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100423.323897:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109441920 00000100:00100000:1.0:1790100423.323910:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109441920 00000100:00100000:1.0:1790100423.323992:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:1.0:1790100423.324005:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:10334:x1877056109441920:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100423.324042:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100423.324071:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefd290 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c72 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100423.324196:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790100423.324370:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefd290 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c72 expref: 30 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.324388:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1b00) 00010000:00010000:1.0:1790100423.324391:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100423.324415:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefd290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c72 expref: 30 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.324438:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12400, rc 0) 00000100:00100000:1.0:1790100423.324756:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:10334:x1877056109441920:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 752us (1210us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1790100423.324764:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:1.0:1790100423.327982:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.328116:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109442048 00000100:00100000:0.0:1790100423.328130:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109442048 00000100:00100000:0.0:1790100423.328253:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:0.0:1790100423.328266:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:10334:x1877056109442048:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:0.0:1790100423.328384:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.328406:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.328455:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.328474:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.328482:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.328489:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.328660:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.328680:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.328688:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100423.329061:0:6711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329091:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329098:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329133:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329211:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100423.329228:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329237:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329268:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100423.329272:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100423.329278:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329285:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd29e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329334:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329374:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329382:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329388:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100423.329401:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329408:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329497:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787edfd00) 00010000:00010000:0.0:1790100423.329500:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100423.329503:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329509:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329959:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329978:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329984:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329987:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100423.329989:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.329993:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.330012:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:0.0:1790100423.330014:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100423.330027:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.330032:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd2ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100423.330481:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:10334:x1877056109442048:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 2210us (2507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100423.330504:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:2.0:1790100423.336294:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.336480:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109442304 00000100:00100000:0.0:1790100423.336493:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109442304 00000100:00100000:0.0:1790100423.336642:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:0.0:1790100423.336655:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:10334:x1877056109442304:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1790100423.337147:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+30:10334:x1877056109442304:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 491us (866us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1790100423.337157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1790100423.374926:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.375032:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109442560 00000100:00100000:3.0:1790100423.375046:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109442560 00000100:00100000:3.0:1790100423.375132:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:3.0:1790100423.375145:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+30:10337:x1877056109442560:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100423.375179:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100423.375207:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd2b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.375308:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.375328:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.375365:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.375387:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.375394:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.375400:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.375591:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.375607:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.376000:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100423.376015:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790100423.377375:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.377393:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.377416:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.377422:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100423.377427:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.377446:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.377468:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:2.0:1790100423.377472:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100423.377478:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.377491:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd2ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.377536:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.377543:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.377548:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.378072:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100423.378077:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.378099:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.378110:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787ec1700) 00010000:00010000:2.0:1790100423.378113:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100423.378117:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.378123:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd2c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.378206:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd2b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c79 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.378224:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c79 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.378231:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:2.0:1790100423.378233:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100423.378236:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900afe00, rc 0) 00000100:00100000:2.0:1790100423.378337:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:10337:x1877056109442560:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 3193us (3425us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1790100423.378348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:1.0:1790100423.382384:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.382481:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109442688 00000100:00100000:0.0:1790100423.382493:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109442688 00000100:00100000:0.0:1790100423.382574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:0.0:1790100423.382587:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:10337:x1877056109442688:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:0.0:1790100423.383001:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.383026:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.383041:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.383141:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.383149:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.383177:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.383183:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100423.383189:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.383197:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.383211:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:0.0:1790100423.383215:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790100423.383220:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.383227:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100423.383382:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:10337:x1877056109442688:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 797us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100423.383391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:1.0:1790100423.387461:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.388003:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109442944 00000100:00100000:3.0:1790100423.388019:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109442944 00000100:00100000:1.0:1790100423.388272:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:1.0:1790100423.388286:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:10337:x1877056109442944:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1790100423.388961:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+33:10337:x1877056109442944:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 673us (1513us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1790100423.388973:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:1.0:1790100423.611475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.611716:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109443200 00000100:00100000:0.0:1790100423.611728:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109443200 00000100:00100000:0.0:1790100423.611887:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:0.0:1790100423.611899:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+33:10368:x1877056109443200:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:0.0:1790100423.611934:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100423.611963:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c80 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.612119:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd2e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.612135:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.612149:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100423.612161:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790100423.612338:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd2dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c80 expref: 36 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.612364:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c80 expref: 35 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.612374:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:0.0:1790100423.612378:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100423.612382:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819000, rc 0) 00000100:00100000:0.0:1790100423.612520:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:10368:x1877056109443200:12345-192.168.201.18@tcp:101:cat.0 Request processed in 624us (1062us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1790100423.612527:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:3.0:1790100423.615187:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.615762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109443456 00000100:00100000:0.0:1790100423.615776:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109443456 00000100:00100000:0.0:1790100423.615907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1790100423.615921:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:10368:x1877056109443456:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:0.0:1790100423.616902:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:10368:x1877056109443456:12345-192.168.201.18@tcp:35:cat.0 Request processed in 978us (1723us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1790100423.616978:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1790100423.617599:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.617726:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109443584 00000100:00100000:3.0:1790100423.617736:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109443584 00000100:00100000:3.0:1790100423.617840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:3.0:1790100423.617850:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:2358:x1877056109443584:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100423.617869:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100423.617909:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd2e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c80 expref: 36 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.617933:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100423.617939:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100423.618003:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:2358:x1877056109443584:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 154us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100423.618020:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:2.0:1790100423.663039:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100423.663158:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109443840 00000100:00100000:1.0:1790100423.663170:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109443840 00000100:00100000:1.0:1790100423.663235:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:1.0:1790100423.663244:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:10374:x1877056109443840:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:1.0:1790100423.663279:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100423.663282:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790100423.663320:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd24a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c56 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.663366:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:1.0:1790100423.663371:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100423.663393:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd2f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.663546:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.663564:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c79 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.663573:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.664277:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c79 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.664307:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c79 expref: 35 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100423.664325:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad199c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126247424:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100423.664475:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100423.668001:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad199c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126247424:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100423.668046:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100423.669800:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.671512:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109443968 00000100:00100000:3.0:1790100423.671533:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109443968 00010000:00010000:3.0:1790100423.671603:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c79 expref: 36 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100423.671771:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:3.0:1790100423.671785:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:2357:x1877056109443968:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100423.671806:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100423.671814:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c79 expref: 36 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.671830:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c79 expref: 36 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.671859:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd2c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c79 expref: 36 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.671880:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100423.671886:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.671917:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.671926:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.671967:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100423.672065:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:2357:x1877056109443968:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 283us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100423.672074:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00010000:00010000:2.0:1790100423.672149:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.672158:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100423.672185:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790100423.672454:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd2f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c87 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.672474:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c87 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100423.672483:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:2.0:1790100423.672486:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790100423.672488:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13000, rc 0) 00000100:00100000:2.0:1790100423.672521:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:10374:x1877056109443840:12345-192.168.201.18@tcp:101:dd.0 Request processed in 9277us (9498us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1790100423.672529:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:1.0:1790100423.674911:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.675029:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109444224 00000100:00100000:3.0:1790100423.675042:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109444224 00000100:00100000:3.0:1790100423.675150:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:3.0:1790100423.675162:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:10374:x1877056109444224:12345-192.168.201.18@tcp:36:dd.0 00010000:00010000:3.0:1790100423.675550:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.675571:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.675585:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100423.675693:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1790100423.675721:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ee45989 reply state 000000002b2eb205 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100423.675731:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100423.675847:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:10374:x1877056109444224:12345-192.168.201.18@tcp:36:dd.0 Request processed in 686us (947us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1790100423.675875:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000020:00080000:3.0:1790100423.675882:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790100423.677481:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.677500:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.677508:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.677515:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100423.677521:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.677530:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.677570:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:0.0:1790100423.677574:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100423.677581:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.677588:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd307 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100423.931668:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100423.931851:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109444352 00000100:00100000:0.0:1790100423.931865:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109444352 00000100:00100000:0.0:1790100423.931945:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:0.0:1790100423.931957:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+37:10388:x1877056109444352:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:0.0:1790100423.931991:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100423.932037:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd30e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c8e expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932130:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932148:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932163:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932182:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932190:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932197:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932364:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932376:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c87 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932385:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932439:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c87 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100423.932462:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c87 expref: 38 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100423.932475:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785128000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6711:1877056126247552:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100423.933820:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6783489900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100423.940637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100423.940748:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109444608 00000100:00100000:2.0:1790100423.940761:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109444608 00000100:00100000:2.0:1790100423.940844:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1790100423.940857:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:5592:x1877056109444608:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790100423.941605:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+40:5592:x1877056109444608:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 745us (995us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1790100423.941681:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1790100423.947002:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785128000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6711:1877056126247552:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100423.947064:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100423.953500:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100423.953678:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109444736 00000100:00100000:3.0:1790100423.953692:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109444736 00010000:00010000:3.0:1790100423.953767:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c87 expref: 40 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100423.953823:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:3.0:1790100423.953836:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+40:2357:x1877056109444736:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100423.953856:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100423.953864:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c87 expref: 40 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.953879:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c87 expref: 40 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.953907:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd2f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c87 expref: 40 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.954132:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100423.954138:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.954150:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.954159:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100423.954231:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100423.954313:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:2357:x1877056109444736:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 478us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100423.954322:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00010000:00010000:1.0:1790100423.954861:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.954889:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100423.954962:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790100423.954969:0:6711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100423.955034:0:6711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955063:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955078:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955087:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955096:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955104:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100423.955110:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955119:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955135:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:1.0:1790100423.955138:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100423.955143:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955161:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955182:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955189:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955194:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955200:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100423.955204:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955209:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955218:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787edfd00) 00010000:00010000:1.0:1790100423.955221:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100423.955224:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955230:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd31c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955279:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd30e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c8e expref: 39 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955295:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c8e expref: 38 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100423.955310:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:1.0:1790100423.955312:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100423.955315:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819000, rc 0) 00000100:00100000:1.0:1790100423.955383:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:10388:x1877056109444352:12345-192.168.201.18@tcp:101:stat.0 Request processed in 23429us (23731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100423.955393:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00010000:00010000:0.0:1790100423.974076:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100424.018567:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100424.018977:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109444992 00000100:00100000:2.0:1790100424.018991:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109444992 00000100:00100000:2.0:1790100424.019244:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:2.0:1790100424.019258:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:10394:x1877056109444992:12345-192.168.201.18@tcp:36:truncate.0 00010000:00010000:2.0:1790100424.019340:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100424.019387:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c8e expref: 38 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.019415:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:2.0:1790100424.019434:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100424.019912:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.019933:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.019946:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100424.020027:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1790100424.020058:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4b2edb6 reply state 000000000ccf7023 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100424.020069:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100424.020215:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+40:10394:x1877056109444992:12345-192.168.201.18@tcp:36:truncate.0 Request processed in 959us (1668us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790100424.020224:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00000020:00080000:2.0:1790100424.020231:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1790100424.025985:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790100424.029237:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.029262:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.029272:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.029279:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100424.029285:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.029295:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.029318:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100424.029321:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100424.029329:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.029336:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd32a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100424.174351:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100424.174433:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109445120 00000100:00100000:3.0:1790100424.174447:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109445120 00000100:00100000:3.0:1790100424.174547:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:3.0:1790100424.174560:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:10408:x1877056109445120:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:3.0:1790100424.174597:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100424.174844:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd331 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c95 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.174945:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.174963:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.174979:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.174996:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175004:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175012:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175132:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175142:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175149:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100424.175218:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1790100424.175224:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100424.175256:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175271:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175280:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175287:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175294:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175301:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aee00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100424.175305:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175315:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175328:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:3.0:1790100424.175331:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100424.175337:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175344:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175368:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175374:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175381:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175386:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100424.175389:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175395:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175403:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787ec1a00) 00010000:00010000:3.0:1790100424.175406:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100424.175409:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175427:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd33f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175465:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd331 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c95 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175481:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c95 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.175500:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100424.175502:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100424.175506:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af800, rc 0) 00000100:00100000:3.0:1790100424.175593:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+40:10408:x1877056109445120:12345-192.168.201.18@tcp:101:stat.0 Request processed in 1035us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100424.175601:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:2.0:1790100424.239186:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100424.239333:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100424.239389:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100424.240878:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109445376 00000100:00100000:3.0:1790100424.240897:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109445376 00000100:00100000:3.0:1790100424.241024:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:3.0:1790100424.241040:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2359:x1877056109445376:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100424.241148:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2359:x1877056109445376:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 113us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100424.241157:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:0.0:1790100424.241801:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109445504 00000100:00100000:0.0:1790100424.241809:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109445504 00000100:00100000:0.0:1790100424.241857:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:0.0:1790100424.241866:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109445504:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100424.241912:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109445504:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 49us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100424.241919:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00080000:2.0:1790100424.241998:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100424.242004:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100424.243784:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109445248 00000100:00100000:1.0:1790100424.243802:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109445248 00000100:00100000:1.0:1790100424.243931:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 277 00000100:00100000:1.0:1790100424.243946:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2359:x1877056109445248:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100424.244063:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2359:x1877056109445248:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 121us (4892us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100424.244071:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 277 00000100:00100000:3.0:1790100424.255007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100424.255105:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109445760 00000100:00100000:1.0:1790100424.255119:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109445760 00000100:00100000:1.0:1790100424.255205:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:1.0:1790100424.255217:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+40:10418:x1877056109445760:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100424.255245:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100424.255282:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd34d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64c9c expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100424.255531:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790100424.255763:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd34d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c9c expref: 42 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.255797:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1b00) 00010000:00010000:1.0:1790100424.255800:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100424.255807:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd34d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c9c expref: 42 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.255825:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13800, rc 0) 00000100:00100000:1.0:1790100424.256032:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+41:10418:x1877056109445760:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 816us (1042us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1790100424.256041:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:2.0:1790100424.270246:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100424.270466:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109446016 00000100:00100000:1.0:1790100424.270481:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109446016 00000100:00100000:1.0:1790100424.270562:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:1.0:1790100424.270575:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+41:10418:x1877056109446016:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1790100424.270952:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+42:10418:x1877056109446016:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 378us (721us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1790100424.270960:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:2.0:1790100424.335446:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100424.336295:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109446272 00000100:00100000:3.0:1790100424.336310:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109446272 00000100:00100000:3.0:1790100424.336394:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:3.0:1790100424.336406:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+42:10424:x1877056109446272:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1790100424.336448:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100424.336474:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd35b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ca3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.336600:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.336671:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c95 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.336701:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.336749:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c95 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.336765:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c95 expref: 43 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100424.336780:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126247680:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100424.337390:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b900 going to sleep for 11 seconds 00000100:00100000:0.0:1790100424.344345:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100424.344492:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109446400 00000100:00100000:2.0:1790100424.344505:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109446400 00010000:00010000:2.0:1790100424.344579:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c95 expref: 44 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100424.344669:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:2.0:1790100424.344682:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+44:2358:x1877056109446400:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100424.344701:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100424.344710:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c95 expref: 44 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.344726:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c95 expref: 44 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.344754:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:2.0:1790100424.344761:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.344773:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.344782:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.344826:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100424.344904:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+44:2358:x1877056109446400:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 224us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100424.344912:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00010000:00010000:3.0:1790100424.345315:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c95 expref: 43 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100424.345337:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126247680:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100424.345364:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.345374:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.345380:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100424.345404:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1790100424.347212:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd35b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ca3 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.347267:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ca3 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.347277:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100424.347280:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100424.347284:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae000, rc 0) 00000100:00100000:3.0:1790100424.347395:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:10424:x1877056109446272:12345-192.168.201.18@tcp:101:bash.0 Request processed in 10991us (11962us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1790100424.347405:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:0.0:1790100424.350496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100424.351166:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109446656 00000100:00100000:3.0:1790100424.351184:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109446656 00000100:00100000:3.0:1790100424.351332:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:3.0:1790100424.351345:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:10424:x1877056109446656:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:3.0:1790100424.351928:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.351949:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.351963:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100424.352018:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1790100424.352041:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067f8d9f5 reply state 000000005b6e2aed transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100424.352050:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100424.352284:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+46:10424:x1877056109446656:12345-192.168.201.18@tcp:36:bash.0 Request processed in 940us (1803us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1790100424.352293:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000020:00080000:3.0:1790100424.352298:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790100424.355382:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.355406:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.355452:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.355461:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aee00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100424.355468:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.355479:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.355504:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:0.0:1790100424.355510:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100424.355517:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.355524:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd370 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100424.365568:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100424.365742:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109446784 00000100:00100000:1.0:1790100424.365755:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109446784 00000100:00100000:1.0:1790100424.365838:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:1.0:1790100424.365851:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+45:10424:x1877056109446784:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1790100424.365888:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100424.365916:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd377 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64caa expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.366036:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.366072:0:11548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ca3 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.366082:0:11548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.366124:0:11548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ca3 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.366139:0:11548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ca3 expref: 46 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100424.366155:0:11548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad539880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126247808:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100424.366268:0:11548:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f82300 going to sleep for 11 seconds 00000100:00100000:2.0:1790100424.369257:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100424.369361:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109446912 00000100:00100000:0.0:1790100424.369374:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109446912 00010000:00010000:0.0:1790100424.369493:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ca3 expref: 47 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100424.369555:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:0.0:1790100424.369568:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:2358:x1877056109446912:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100424.369587:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100424.369595:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ca3 expref: 47 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.369688:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ca3 expref: 47 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.369718:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:0.0:1790100424.369725:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.369738:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.369747:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.369771:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100424.369834:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:2358:x1877056109446912:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 269us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100424.369843:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00010000:00010000:1.0:1790100424.370361:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd362 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ca3 expref: 46 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100424.370384:0:11548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad539880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126247808:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100424.370430:0:11548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.370440:0:11548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.370447:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100424.370510:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790100424.370524:0:11548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100424.370565:0:11548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.370606:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd377 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64caa expref: 46 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.370682:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64caa expref: 45 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.370692:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:1.0:1790100424.370695:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100424.370698:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13600, rc 0) 00000100:00100000:1.0:1790100424.370755:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+45:10424:x1877056109446784:12345-192.168.201.18@tcp:101:bash.0 Request processed in 4906us (5201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100424.370763:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:2.0:1790100424.376121:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100424.376866:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109447168 00000100:00100000:1.0:1790100424.376884:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109447168 00000100:00100000:1.0:1790100424.377030:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:1.0:1790100424.377045:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d679e03b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+45:10424:x1877056109447168:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:1.0:1790100424.377423:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d679e03b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+46:10424:x1877056109447168:12345-192.168.201.18@tcp:35:bash.0 Request processed in 370us (1307us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1790100424.377432:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1790100424.445907:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100424.445989:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109447424 00000100:00100000:2.0:1790100424.446376:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109447424 00000100:00100000:2.0:1790100424.446468:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:2.0:1790100424.446482:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+46:10434:x1877056109447424:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100424.446518:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100424.446545:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd385 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64cb1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100424.446699:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790100424.446874:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd385 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cb1 expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.446890:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1b00) 00010000:00010000:2.0:1790100424.446893:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100424.446897:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd385 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cb1 expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.446910:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142200, rc 0) 00000100:00100000:2.0:1790100424.447184:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:10434:x1877056109447424:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 698us (1282us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1790100424.447209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:0.0:1790100424.449859:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100424.449982:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109447552 00000100:00100000:3.0:1790100424.449995:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109447552 00000100:00100000:3.0:1790100424.450106:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:3.0:1790100424.450118:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:10434:x1877056109447552:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:3.0:1790100424.450217:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450237:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450256:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450278:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450286:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450293:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450447:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450457:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450492:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100424.450671:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450687:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450693:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450701:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450708:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100424.450713:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450721:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450735:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:3.0:1790100424.450746:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100424.450752:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450759:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd393 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450774:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450788:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450794:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450800:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900afe00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100424.450803:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450810:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450819:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787ec1a00) 00010000:00010000:3.0:1790100424.450821:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100424.450824:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450830:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd39a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450846:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450853:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450859:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450864:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100424.450874:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450881:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450888:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:3.0:1790100424.450891:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100424.450894:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100424.450901:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd3a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100424.451053:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:10434:x1877056109447552:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 934us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100424.451063:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:1.0:1790100424.453371:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100424.453492:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109447808 00000100:00100000:3.0:1790100424.453502:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109447808 00000100:00100000:3.0:1790100424.453567:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1790100424.453578:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:10434:x1877056109447808:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100424.453907:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+48:10434:x1877056109447808:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 329us (548us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1790100424.453914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1790100424.502764:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100424.507577:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109448064 00000100:00100000:1.0:1790100424.507600:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109448064 00000100:00100000:1.0:1790100424.507723:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:1.0:1790100424.507737:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+48:10437:x1877056109448064:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100424.507800:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100424.507841:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd3a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64cb8 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.507949:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.507968:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.507983:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508269:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508280:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508288:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508514:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd3bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508524:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508532:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100424.508543:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790100424.508723:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508732:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508739:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508745:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100424.508750:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508760:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508774:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:1.0:1790100424.508777:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100424.508782:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508789:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd3af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508803:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508809:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508816:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508830:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100424.508833:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508839:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508846:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6799df4400) 00010000:00010000:1.0:1790100424.508848:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100424.508850:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508856:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508902:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd3a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cb8 expref: 51 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508916:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd3bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cb8 expref: 50 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.508924:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:1.0:1790100424.508926:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100424.508928:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13800, rc 0) 00000100:00100000:1.0:1790100424.509935:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:10437:x1877056109448064:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1275us (6262us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1790100424.509950:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:0.0:1790100424.512602:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100424.512734:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109448192 00000100:00100000:2.0:1790100424.512747:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109448192 00000100:00100000:2.0:1790100424.512816:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:2.0:1790100424.512834:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:10437:x1877056109448192:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1790100424.512917:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.512936:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.512949:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.512981:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.512988:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.513005:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.513016:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100424.513021:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.513030:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.513064:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:2.0:1790100424.513067:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100424.513071:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.513077:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd3cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100424.513152:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:10437:x1877056109448192:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 320us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100424.513159:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:2.0:1790100424.515565:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100424.515813:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109448320 00000100:00100000:0.0:1790100424.515835:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109448320 00000100:00100000:0.0:1790100424.515920:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:0.0:1790100424.515932:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:2360:x1877056109448320:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100424.515951:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100424.515981:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd3bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cb8 expref: 50 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.516037:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:0.0:1790100424.516044:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100424.516115:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+49:2360:x1877056109448320:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 185us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100424.516123:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1790100424.518770:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100424.519157:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109448576 00000100:00100000:0.0:1790100424.519170:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109448576 00000100:00100000:0.0:1790100424.519236:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:0.0:1790100424.519248:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+49:10437:x1877056109448576:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1790100424.519590:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:10437:x1877056109448576:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 343us (835us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1790100424.519599:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1790100424.665873:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100424.665961:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109448832 00000100:00100000:2.0:1790100424.665974:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109448832 00000100:00100000:2.0:1790100424.666066:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:2.0:1790100424.666079:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:10455:x1877056109448832:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:2.0:1790100424.666115:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100424.666156:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd3d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64cbf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.666302:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd3d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.666320:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.666335:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100424.666373:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790100424.666586:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd3d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cbf expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.666674:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cbf expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.666684:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:2.0:1790100424.666688:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790100424.666692:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142800, rc 0) 00000100:00100000:2.0:1790100424.666787:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10455:x1877056109448832:12345-192.168.201.18@tcp:101:cat.0 Request processed in 710us (927us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790100424.666795:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:2.0:1790100424.684766:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100424.685012:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109448960 00000100:00100000:0.0:1790100424.685025:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109448960 00000100:00100000:0.0:1790100424.685100:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:0.0:1790100424.685110:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10456:x1877056109448960:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100424.685139:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100424.685164:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd3e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64cc6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.685251:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd3ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.685270:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.685308:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100424.685392:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790100424.685396:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100424.685428:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd3ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.685464:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd3e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cc6 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.685490:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd3ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cc6 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100424.685499:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100424.685502:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100424.685506:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818400, rc 0) 00000100:00100000:0.0:1790100424.685593:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10456:x1877056109448960:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 484us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100424.685601:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:3.0:1790100424.689252:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100424.689404:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109449344 00000100:00100000:0.0:1790100424.689427:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109449344 00000100:00100000:0.0:1790100424.689505:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1790100424.689518:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10456:x1877056109449344:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1790100424.690422:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10456:x1877056109449344:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 894us (1178us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1790100424.690433:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1790100424.693258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100424.693351:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109449472 00000100:00100000:2.0:1790100424.693364:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109449472 00000100:00100000:2.0:1790100424.693493:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:2.0:1790100424.693507:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10456:x1877056109449472:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:2.0:1790100424.693528:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790100424.693569:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd37e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64caa expref: 54 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.693596:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd3d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cbf expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.693665:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd289 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c6b expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.693700:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:2.0:1790100424.693712:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100424.694552:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:10456:x1877056109449472:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 1043us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100424.694563:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1790100424.697343:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100424.697717:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109449600 00000100:00100000:1.0:1790100424.697828:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109449600 00000100:00100000:1.0:1790100424.697997:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:1.0:1790100424.698012:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:10456:x1877056109449600:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:1.0:1790100424.698173:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.698195:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100424.698210:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100424.698647:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100424.699109:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1790100424.699195:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1790100424.699343:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:10456:x1877056109449600:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 1331us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100424.699355:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:1.0:1790100424.717021:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100424.717344:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109449728 00000100:00100000:2.0:1790100424.717362:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109449728 00000100:00100000:2.0:1790100424.717460:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:2.0:1790100424.717474:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:10458:x1877056109449728:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100424.717505:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100424.717534:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd3fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ccd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.717873:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.717894:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.717908:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.717925:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.717931:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.717963:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718087:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718103:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100424.718156:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790100424.718161:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100424.718184:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718198:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718209:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718216:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718223:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718229:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100424.718234:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718250:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718265:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:2.0:1790100424.718269:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100424.718276:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718282:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd403 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718298:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718304:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718310:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718316:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100424.718318:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718325:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718332:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787def500) 00010000:00010000:2.0:1790100424.718335:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100424.718337:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718354:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd40a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.718397:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd3fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ccd expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.721361:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ccd expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100424.721383:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4400) 00010000:00010000:2.0:1790100424.721387:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100424.721392:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142000, rc 0) 00000100:00100000:2.0:1790100424.721509:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10458:x1877056109449728:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 4036us (4503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100424.721520:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:3.0:1790100424.934750:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100424.934783:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126247936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100424.934872:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100424.935092:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126247936 00000100:00100000:2.0:1790100424.935107:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126247936 00000100:00100000:2.0:1790100424.935186:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790100424.935197:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126247936:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790100424.935213:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1790100424.935239:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100424.935345:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126247936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100424.935363:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790100424.935565:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126247936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100424.939326:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126248064:0@lo:400:kworker.0 00000100:00100000:0.0:1790100424.939380:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126248192:0@lo:400:kworker.0 00000100:00100000:1.0:1790100424.941431:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126248448:0@lo:400:kworker.0 00000100:00100000:3.0:1790100424.946111:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100424.946383:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126248576:0@lo:400:kworker.0 00000100:00100000:2.0:1790100424.946682:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126248064 00000100:00100000:2.0:1790100424.946695:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126248064 00000100:00100000:2.0:1790100424.946765:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1790100424.946777:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126248064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100424.946909:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100424.946965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126248576 00000100:00100000:3.0:1790100424.946970:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126248576 00000100:00100000:3.0:1790100424.947013:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790100424.947020:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126248576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100424.947128:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126248576:12345-0@lo:400:kworker.0 Request processed in 43us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100424.947136:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1790100424.947171:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100424.947208:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126248576:0@lo:400:kworker.0 00000100:00100000:3.0:1790100424.950804:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126248320:0@lo:400:kworker.0 00000100:00100000:3.0:1790100424.950924:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100424.951718:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126248320 00000100:00100000:3.0:1790100424.951731:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126248320 00000100:00100000:3.0:1790100424.951815:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790100424.951825:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126248320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100424.951960:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126248320:12345-0@lo:400:kworker.0 Request processed in 135us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100424.951974:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1790100424.952002:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100424.952042:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126248320:0@lo:400:kworker.0 00000100:00100000:0.0:1790100424.952148:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100424.952192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126248192 00000100:00100000:3.0:1790100424.952199:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126248192 00000100:00100000:3.0:1790100424.952242:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790100424.952254:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126248192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100424.952551:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126248192:0@lo:400:kworker.0 00000100:00100000:1.0:1790100424.953138:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100424.953249:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126248448 00000100:00100000:0.0:1790100424.953318:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126248448 00000100:00100000:0.0:1790100424.953466:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790100424.953479:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126248448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100424.953503:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126248192:12345-0@lo:400:kworker.0 Request processed in 1247us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100424.953515:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790100424.953559:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad539500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126248448:12345-0@lo:400:kworker.0 Request processed in 82us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100424.953566:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790100424.953711:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126248448:0@lo:400:kworker.0 00000100:00100000:3.0:1790100424.954089:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126248064:12345-0@lo:400:kworker.0 Request processed in 7311us (7991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100424.954102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1790100424.954181:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126248064:0@lo:400:kworker.0 00010000:00010000:3.0:1790100424.998033:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100425.192978:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100425.192991:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790100425.193078:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790100425.193091:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790100425.193284:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad539180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126248704:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790100425.193426:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f82240 going to sleep for 11 seconds 00000100:00100000:3.0:1790100425.200475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.202813:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad539180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126248704:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790100425.207831:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109449856 00000100:00100000:1.0:1790100425.207855:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109449856 00000100:00100000:1.0:1790100425.207952:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:1.0:1790100425.207964:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10469:x1877056109449856:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790100425.208088:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10469:x1877056109449856:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 Request processed in 126us (7631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100425.208097:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:1.0:1790100425.217414:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.217513:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109449984 00000100:00100000:3.0:1790100425.217536:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109449984 00000100:00100000:3.0:1790100425.217652:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:3.0:1790100425.217664:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10469:x1877056109449984:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790100425.217706:0:11548:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790100425.217889:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10469:x1877056109449984:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 225us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100425.217897:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:2.0:1790100425.223729:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.223906:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109450112 00000100:00100000:3.0:1790100425.223919:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109450112 00000100:00100000:3.0:1790100425.223999:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:3.0:1790100425.224032:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10469:x1877056109450112:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790100425.224142:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224164:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224179:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224198:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224206:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224213:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224249:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224258:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224266:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100425.224318:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790100425.224324:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100425.224347:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224373:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224381:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224389:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224407:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100425.224413:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224422:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224437:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:3.0:1790100425.224441:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100425.224447:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224454:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd418 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224469:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224476:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224483:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224496:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900afe00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100425.224500:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224506:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224516:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d6787ec1a00) 00010000:00010000:3.0:1790100425.224519:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100425.224521:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224528:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd41f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224545:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224551:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224557:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224562:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100425.224564:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224571:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224589:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4400) 00010000:00010000:3.0:1790100425.224592:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100425.224596:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.224603:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.225027:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10469:x1877056109450112:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 711us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100425.225039:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1790100425.237918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.243736:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109450368 00000100:00100000:2.0:1790100425.243770:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109450368 00000100:00100000:3.0:1790100425.244008:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:3.0:1790100425.244020:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10469:x1877056109450368:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100425.244046:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100425.244071:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd42d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64cd4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244196:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244214:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244227:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100425.244239:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790100425.244363:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244379:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244386:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244392:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aea00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100425.244408:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244416:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244431:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4400) 00010000:00010000:3.0:1790100425.244433:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100425.244439:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244445:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244496:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd42d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cd4 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244507:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:3.0:1790100425.244510:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100425.244514:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd42d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cd4 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.244536:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af000, rc 0) 00000100:00100000:3.0:1790100425.245155:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10469:x1877056109450368:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1133us (7246us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1790100425.245165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:1.0:1790100425.255472:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100425.257814:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109450496 00000100:00100000:0.0:1790100425.257836:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109450496 00000100:00100000:1.0:1790100425.258116:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:1.0:1790100425.258130:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10469:x1877056109450496:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790100425.258181:0:6711:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790100425.258333:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10469:x1877056109450496:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 206us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100425.258341:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:1.0:1790100425.263365:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.266886:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109450752 00000100:00100000:2.0:1790100425.266908:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109450752 00000100:00100000:2.0:1790100425.267050:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:2.0:1790100425.267064:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10469:x1877056109450752:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100425.267092:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100425.267097:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790100425.267133:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd3ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cc6 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.267163:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:2.0:1790100425.267169:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100425.267188:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefd442 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64cdb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790100425.267820:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1790100425.268082:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd449 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.268100:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.268112:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.268189:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefd442 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cdb expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.268207:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd449 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cdb expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.268215:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787defe00) 00010000:00010000:2.0:1790100425.268218:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100425.268221:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143200, rc 0) 00000100:00100000:2.0:1790100425.268315:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10469:x1877056109450752:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1254us (4962us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1790100425.268325:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:1.0:1790100425.273249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100425.273405:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109451008 00000100:00100000:0.0:1790100425.273419:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109451008 00000100:00100000:0.0:1790100425.273520:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:0.0:1790100425.273541:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10469:x1877056109451008:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100425.273865:0:11548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100425.273900:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefd449 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cdb expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.273919:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787defe00) 00010000:00010000:0.0:1790100425.273931:0:11548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100425.274010:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274028:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274040:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274056:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274063:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274069:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274161:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274168:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274176:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274181:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100425.274186:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274194:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274202:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:2.0:1790100425.274205:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100425.274210:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274216:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd457 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274226:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274232:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274239:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274250:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100425.274253:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274259:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274268:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x370d1b2a (ffff8d6787defa00) 00010000:00010000:2.0:1790100425.274271:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100425.274273:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.274280:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd45e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x370d1b2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100425.274391:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10469:x1877056109451008:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 852us (1154us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790100425.274409:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:1.0:1790100425.282012:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100425.282471:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109451136 00000100:00100000:0.0:1790100425.282486:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109451136 00000100:00100000:0.0:1790100425.282572:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:0.0:1790100425.282586:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10469:x1877056109451136:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100425.282669:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100425.282700:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd465 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ce2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.282745:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.282763:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.282777:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.282905:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce2 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.282928:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce2 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.282938:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:0.0:1790100425.282942:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790100425.282946:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819200, rc 0) 00000100:00100000:0.0:1790100425.283027:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10469:x1877056109451136:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 443us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100425.283035:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:3.0:1790100425.287014:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.287329:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109451392 00000100:00100000:2.0:1790100425.287343:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109451392 00000100:00100000:2.0:1790100425.287425:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:2.0:1790100425.287438:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10469:x1877056109451392:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100425.287591:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.287646:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.287661:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100425.288117:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1790100425.288130:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321857518556ns, next at 322857515855ns, rc = 0 00000004:00010000:2.0:1790100425.288237:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000377e8ef reply state 0000000047d8f12e transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100425.288249:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100425.288379:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:10469:x1877056109451392:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 942us (1380us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1790100425.288387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 75 00010000:00010000:1.0:1790100425.291948:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.291974:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.291983:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.292017:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100425.292023:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.292032:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.292056:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:1.0:1790100425.292060:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100425.292066:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.292073:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd473 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.293956:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.295527:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109451520 00000100:00100000:2.0:1790100425.295549:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109451520 00000100:00100000:2.0:1790100425.295820:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:2.0:1790100425.295833:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10469:x1877056109451520:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100425.295866:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100425.295892:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ce9 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.295980:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce9 expref: 56 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.295998:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce9 expref: 56 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.296022:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:2.0:1790100425.296026:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100425.296030:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143a00, rc 0) 00000100:00100000:2.0:1790100425.296143:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:10469:x1877056109451520:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 312us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100425.296150:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:1.0:1790100425.302911:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100425.303905:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109451648 00000100:00100000:0.0:1790100425.303921:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109451648 00000100:00100000:0.0:1790100425.304022:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:0.0:1790100425.304032:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1877056109451648:12345-192.168.201.18@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1790100425.304093:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1790100425.304133:0:6690:0:(genops.c:1384:class_connect()) connect: client dd2cd87b-6ca1-4323-9b74-fad785d94e6c, cookie 0x31a8f3fdeeefd481 00002000:00100000:0.0:1790100425.304148:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd2cd87b-6ca1-4323-9b74-fad785d94e6c/ffff8d6799d92000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790100425.304162:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790100425.304483:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790100425.304863:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8d6799d94000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100425.305023:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2356:x1877056109451648:12345-192.168.201.18@tcp:8:lhsmtool_posix.0 Request processed in 989us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100425.305033:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1790100425.308367:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100425.308807:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109451776 00000100:00100000:0.0:1790100425.308820:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109451776 00000100:00100000:0.0:1790100425.308913:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:0.0:1790100425.308925:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:0:x1877056109451776:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790100425.309597:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100425.391470:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:0:x1877056109451776:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 82526us (83095us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790100425.391491:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000001:00080000:0.0:1790100425.391542:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1790100425.391553:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000100:00100000:0.0:1790100425.399024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.399122:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109452032 00000100:00100000:3.0:1790100425.399139:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109452032 00000100:00100000:3.0:1790100425.399235:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:3.0:1790100425.399247:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:10469:x1877056109452032:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790100425.399692:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:10469:x1877056109452032:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 445us (687us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1790100425.399707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:0.0:1790100425.404971:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.405049:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109452288 00000100:00100000:3.0:1790100425.405061:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109452288 00000100:00100000:3.0:1790100425.406421:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:3.0:1790100425.406453:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:10469:x1877056109452288:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790100425.406639:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:10469:x1877056109452288:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 199us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100425.406648:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:1.0:1790100425.413456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.413816:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109452416 00000100:00100000:2.0:1790100425.413838:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109452416 00000100:00100000:3.0:1790100425.414059:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:3.0:1790100425.414073:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:10469:x1877056109452416:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100425.414099:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100425.414126:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd488 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64cf0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.414231:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd48f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.414249:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd48f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.414270:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd48f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100425.414319:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100425.414351:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd48f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.414389:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd488 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf0 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.414421:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd48f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf0 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.414431:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:3.0:1790100425.414434:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790100425.414444:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af000, rc 0) 00000100:00100000:3.0:1790100425.414590:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:10469:x1877056109452416:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 519us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100425.414599:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:1.0:1790100425.419906:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.419988:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109452544 00000100:00100000:3.0:1790100425.420002:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109452544 00000100:00100000:3.0:1790100425.420076:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:3.0:1790100425.420104:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109452544:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100425.420131:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100425.420162:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64cf7 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100425.420207:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c3c8, blocks: 0x1 00010000:00010000:3.0:1790100425.420231:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1790100425.420237:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100425.420248:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf7 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.420279:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf7 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.420302:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af800, rc 0) 00000100:00100000:3.0:1790100425.420385:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109452544:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 284us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100425.420410:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:3.0:1790100425.425775:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.425836:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109452800 00000100:00100000:2.0:1790100425.425848:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109452800 00000100:00100000:2.0:1790100425.425960:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:2.0:1790100425.425974:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:10469:x1877056109452800:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790100425.426126:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:10469:x1877056109452800:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 155us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100425.426133:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:3.0:1790100425.428938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100425.429944:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109452928 00000100:00100000:0.0:1790100425.429962:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109452928 00000100:00100000:0.0:1790100425.430036:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1790100425.430047:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:10469:x1877056109452928:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100425.430070:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100425.430111:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64cfe expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.430155:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf7 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.430164:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100425.430170:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100425.430176:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.430219:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf7 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.430236:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf7 expref: 7 pid: 6690 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100425.430252:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad537b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1877056126248832:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100425.430368:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a943a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100425.436964:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.437414:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109453056 00000100:00100000:3.0:1790100425.437427:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109453056 00010000:00010000:3.0:1790100425.437495:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf7 expref: 8 pid: 6690 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.437708:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:3.0:1790100425.437735:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109453056:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100425.437812:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100425.437842:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf7 expref: 8 pid: 6690 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.437860:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf7 expref: 8 pid: 6690 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.437894:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790100425.437900:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100425.437910:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.437923:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.437978:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.437994:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1877056126248960:192.168.201.18@tcp:105: 00000100:00100000:3.0:1790100425.438105:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b272b3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790100425.441208:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefd496 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf7 expref: 8 pid: 6690 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100425.441235:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad537b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1877056126248832:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100425.441274:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.441312:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819a00, rc 0) 00000100:00100000:0.0:1790100425.441419:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:10469:x1877056109452928:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 11372us (12496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100425.441430:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:3.0:1790100425.442686:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1877056126248960:192.168.201.18@tcp:105: 00010000:00010000:3.0:1790100425.442711:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100425.444797:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109453056:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 7050us (7833us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100425.444838:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:3.0:1790100425.447637:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.447862:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109453184 00000100:00100000:2.0:1790100425.447874:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109453184 00002000:00100000:2.0:1790100425.447933:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d67bf4ae680 x1877056109453184/t0(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:721/0 lens 504/0 e 0 to 0 dl 1790100436 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100425.447945:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf4ae680 with x1877056109453184 ext(0->8) 00002000:00010000:2.0:1790100425.447951:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bf4ae680 00000100:00100000:2.0:1790100425.447981:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1790100425.447992:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109453184:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790100425.449212:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109453184:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 1213us (1607us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790100425.449225:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00002000:00100000:2.0:1790100425.449238:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d67bf4ae680 x1877056109453184/t4294967302(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:721/0 lens 504/448 e 0 to 0 dl 1790100436 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100425.449260:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf4ae680 with x1877056109453184 ext(0->8) 00002000:00010000:2.0:1790100425.449267:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bf4ae680 00000100:00100000:2.0:1790100425.453583:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.453717:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109453312 00000100:00100000:3.0:1790100425.453730:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109453312 00000100:00100000:3.0:1790100425.453812:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:3.0:1790100425.453824:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:10469:x1877056109453312:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790100425.504513:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:10469:x1877056109453312:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 50674us (50927us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100425.504531:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00000001:00080000:0.0:1790100425.504582:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1790100425.504601:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1790100425.504670:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1790100425.504675:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:0.0:1790100425.504711:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1790100425.504928:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d67b272b480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1790100425.504933:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6782e74600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d67b272ba80 00000020:00080000:0.0:1790100425.504936:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d678793f900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d67bf3cfc00 00000020:00080000:0.0:1790100425.505185:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1790100425.505297:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126249216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790100425.505370:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1790100425.505416:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790100425.505430:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126249088:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790100425.505460:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100425.505463:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126249216 00000100:00100000:2.0:1790100425.505473:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126249216 00000100:00100000:0.0:1790100425.505492:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126249088 00000100:00100000:0.0:1790100425.505495:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126249088 00000100:00100000:0.0:1790100425.505531:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790100425.505542:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126249216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790100425.505731:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790100425.505858:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790100424 00002000:00010000:0.0:1790100425.505861:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790100425.505864:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790100424 -> 1790100424 00002000:00010000:0.0:1790100425.505866:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790100425.505908:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126249216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 368us (537us total) trans 4294967303 rc 0/0 00000040:00080000:1.0:1790100425.507229:0:12001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100425.507238:0:12001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790100425.507289:0:12001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790100425.507300:0:12001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100425.507580:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790100425.507639:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790100425.507655:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1877056126249088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790100425.507691:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1790100425.507728:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6ab2c3c6, atime: 0x6ab2c3c6, ctime: 0x6ab2c3c6, blocks: 0x1 00010000:00010000:0.0:1790100425.509062:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.509088:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1790100425.509094:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100425.509101:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.509121:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.509134:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.509143:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.509187:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1790100425.509680:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790100425.509751:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100425.509761:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.509771:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100425.509777:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.509787:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.509814:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.509822:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd4a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.509847:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100425.509848:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100425.509850:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100425.510221:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.510305:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790100425.510315:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790100425.510364:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1877056126249088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2714us (4900us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790100425.510375:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790100425.510416:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109453440 00000100:00100000:0.0:1790100425.510425:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109453440 00000100:00100000:0.0:1790100425.510474:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:0.0:1790100425.510483:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109453440:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1790100425.511126:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67ad537b80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1790100425.511134:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126249088:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1790100425.511166:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67ad537800/2, rc 0, transno 4294967303 00000100:00100000:0.0:1790100425.511170:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126249216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790100425.566098:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109453440:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 55598us (55865us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100425.566119:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000001:00080000:2.0:1790100425.566167:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1790100425.566178:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1790100425.569041:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.569344:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109453696 00000100:00100000:3.0:1790100425.569355:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109453696 00000100:00100000:3.0:1790100425.569444:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:3.0:1790100425.569456:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:10469:x1877056109453696:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790100425.569862:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100425.570089:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd48f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cf0 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.570110:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:3.0:1790100425.570116:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100425.570160:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.570177:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.570189:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100425.570672:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7eb2b2b reply state 00000000fe7fe858 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.570684:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100425.570888:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:10469:x1877056109453696:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1432us (1859us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790100425.570897:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00010000:00010000:1.0:1790100425.573845:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.573867:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.573887:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.573894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:1.0:1790100425.573894:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aea00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100425.573901:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.573909:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.573929:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:1.0:1790100425.573933:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100425.573938:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.573945:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd4ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100425.573966:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109453824 00000100:00100000:2.0:1790100425.573979:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109453824 00000100:00100000:2.0:1790100425.574047:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:2.0:1790100425.574059:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109453824:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790100425.574387:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1790100425.574402:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790100424 -> 1790100423 00002000:00010000:2.0:1790100425.574405:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790100422 00002000:00010000:2.0:1790100425.574407:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790100424 -> 1790100423 00002000:00010000:2.0:1790100425.574410:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790100425.574534:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2357:x1877056109453824:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 473us (640us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790100425.574553:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:3.0:1790100425.578916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100425.579008:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109454080 00000100:00100000:0.0:1790100425.579021:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109454080 00000100:00100000:0.0:1790100425.579097:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:0.0:1790100425.579109:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:10469:x1877056109454080:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790100425.579203:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.579224:0:11548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce2 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.579234:0:11548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.579290:0:11548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce2 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.579306:0:11548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce2 expref: 13 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100425.579322:0:11548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad535500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126249344:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100425.579435:0:11548:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043000 going to sleep for 11 seconds 00000100:00100000:3.0:1790100425.581262:0:11548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad535500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126249344:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100425.581301:0:11548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.582662:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100425.582837:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109454208 00000100:00100000:0.0:1790100425.582848:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109454208 00010000:00010000:0.0:1790100425.582894:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce2 expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100425.582934:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:0.0:1790100425.582944:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:2358:x1877056109454208:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100425.582961:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100425.582969:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce2 expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.582983:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce2 expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.583008:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd46c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce2 expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.583026:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:0.0:1790100425.583040:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.583053:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.583061:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100425.583086:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100425.583152:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2358:x1877056109454208:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 209us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100425.583160:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00010000:00010000:3.0:1790100425.583915:0:11548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.583927:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.583966:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.583974:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.583982:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.583989:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100425.583994:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.584002:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.584014:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:3.0:1790100425.584018:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790100425.584022:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.584029:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.584104:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:10469:x1877056109454080:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 4996us (5200us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790100425.584113:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:0.0:1790100425.587318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100425.587436:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109454336 00000100:00100000:1.0:1790100425.587449:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109454336 00000100:00100000:1.0:1790100425.587525:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:1.0:1790100425.587536:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109454336:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790100425.587592:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.588095:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.588109:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100425.588119:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100425.588126:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.588238:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.588257:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 7 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.588274:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877056126249472:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100425.588384:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735600 going to sleep for 11 seconds 00000100:00100000:1.0:1790100425.590882:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877056126249472:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100425.590920:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100425.592069:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100425.592137:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109454464 00000100:00100000:1.0:1790100425.592147:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109454464 00010000:00010000:1.0:1790100425.592209:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 8 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100425.592253:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:1.0:1790100425.592264:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109454464:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100425.592282:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100425.592315:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 8 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592330:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 8 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592359:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b67bee1/0x31a8f3fdeeefd49d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64cfe expref: 8 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592377:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100425.592389:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100425.592407:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592418:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592448:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100425.592531:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109454464:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 258us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100425.592539:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00010000:00010000:1.0:1790100425.592566:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592577:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592607:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592745:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592753:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592761:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100425.592772:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592782:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592794:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.592801:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd4b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100425.592859:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109454336:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 5324us (5555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100425.592868:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:0.0:1790100425.595519:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.595700:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109454720 00000100:00100000:3.0:1790100425.595712:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109454720 00000100:00100000:3.0:1790100425.595818:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:3.0:1790100425.595832:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:10469:x1877056109454720:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790100425.595954:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.595980:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.595996:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.596338:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.596362:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce9 expref: 13 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.596371:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.596428:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce9 expref: 13 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.596446:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce9 expref: 13 pid: 11548 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.596463:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126249600:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100425.596571:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100425.600607:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100425.600695:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126249600:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100425.600732:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100425.600875:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109454848 00000100:00100000:2.0:1790100425.600884:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109454848 00010000:00010000:2.0:1790100425.600928:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce9 expref: 14 pid: 11548 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100425.600963:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1790100425.600969:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790100425.600973:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad537480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:2358:x1877056109454848:12345-192.168.201.18@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790100425.600979:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1790100425.600990:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100425.600999:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce9 expref: 14 pid: 11548 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.601011:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce9 expref: 14 pid: 11548 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.601037:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd47a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ce9 expref: 14 pid: 11548 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.601051:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:2.0:1790100425.601056:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.601068:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.601077:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.601122:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100425.601167:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.601175:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100425.601183:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad537480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2358:x1877056109454848:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 211us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100425.601190:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000001:00080000:3.0:1790100425.602095:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1790100425.602354:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1790100425.602417:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1790100425.602519:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1877056126249728:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790100425.602586:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100425.602705:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100425.602800:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126249728 00000100:00100000:0.0:1790100425.602809:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126249728 00000100:00100000:0.0:1790100425.602908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100425.602918:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1877056126249728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790100425.603022:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1877056126249728:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100425.603031:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100425.603090:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1790100425.603098:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67ad537800, transno 4294967303 00000100:00100000:3.0:1790100425.603123:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1877056126249728:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1790100425.603735:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1790100425.603806:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1877056126249856:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790100425.603850:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100425.604219:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787d706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100425.604551:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126249856 00000100:00100000:1.0:1790100425.604561:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126249856 00000100:00100000:1.0:1790100425.604603:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790100425.604635:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1877056126249856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790100425.604867:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1877056126249856:12345-0@lo:1000:mdt00_000.0 Request processed in 255us (1016us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790100425.604885:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100425.605061:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1877056126249856:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1790100425.605107:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605119:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605128:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605135:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900afe00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100425.605141:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605150:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605168:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:3.0:1790100425.605172:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100425.605177:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605184:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605290:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605303:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605310:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605315:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100425.605319:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605325:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605334:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4400) 00010000:00010000:3.0:1790100425.605336:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100425.605339:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605345:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd3f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605368:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605386:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ccd expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605407:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605442:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ccd expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.605463:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ccd expref: 16 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100425.605479:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126249984:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100425.605563:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787d706c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100425.608574:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126249984:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100425.608663:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100425.610101:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100425.610147:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109454976 00000100:00100000:2.0:1790100425.610158:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109454976 00010000:00010000:2.0:1790100425.610208:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ccd expref: 17 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100425.610294:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:2.0:1790100425.610307:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:2357:x1877056109454976:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100425.610327:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100425.610336:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ccd expref: 17 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.610350:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ccd expref: 17 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.610379:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd411 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ccd expref: 17 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.610405:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4400) 00010000:00010000:2.0:1790100425.610411:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.610423:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.610448:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.610532:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100425.610633:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:2357:x1877056109454976:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 306us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100425.610641:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00010000:00010000:1.0:1790100425.610748:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610758:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610776:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610783:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610791:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610798:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100425.610803:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610811:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610822:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4400) 00010000:00010000:1.0:1790100425.610826:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100425.610830:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610836:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd4ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610850:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610863:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610869:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610875:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100425.610878:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610885:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610894:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4400) 00010000:00010000:1.0:1790100425.610896:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790100425.610899:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100425.610905:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd4c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100425.611187:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:10469:x1877056109454720:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 15357us (15683us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1790100425.611197:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00000020:00080000:1.0:1790100425.611202:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790100425.611415:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100425.611421:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100425.611451:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790100425.611457:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100425.612877:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100425.612928:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109455232 00000100:00100000:3.0:1790100425.612938:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109455232 00000100:00100000:3.0:1790100425.613038:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1790100425.613050:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:10469:x1877056109455232:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790100425.613981:0:5845:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790100425.614109:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1790100425.614164:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.614187:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.614203:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.614212:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.614229:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.614235:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100425.614264:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790100425.614388:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:10469:x1877056109455232:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 1336us (1513us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1790100425.614410:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000020:00080000:3.0:1790100425.614417:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790100425.614425:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100425.614433:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.614440:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900afe00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100425.614449:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.614458:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.614473:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d6787ec1600) 00010000:00010000:2.0:1790100425.614475:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790100425.614482:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.614488:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd4d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100425.614505:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100425.614507:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100425.614508:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100425.958299:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126250112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100425.958424:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100425.958828:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126250112 00000100:00100000:2.0:1790100425.958840:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126250112 00000100:00100000:2.0:1790100425.958912:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790100425.958923:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1877056126250112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100425.958970:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100425.959031:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1877056126250112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100425.959039:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790100425.959102:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126250112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100426.022337:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100427.046026:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100427.427525:0:12054:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100427.427535:0:12054:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100427.427571:0:12054:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1790100427.427579:0:12054:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790100427.544197:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100427.544474:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109455488 00000100:00100000:3.0:1790100427.544543:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109455488 00000100:00100000:3.0:1790100427.544684:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:3.0:1790100427.544697:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:10488:x1877056109455488:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100427.544723:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100427.544745:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd4dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d05 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.544855:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd4e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.544870:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd4e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.544897:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd4e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100427.544911:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790100427.545066:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd4dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d05 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.545086:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd4e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d05 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.545095:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:3.0:1790100427.545098:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100427.545102:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900aee00, rc 0) 00000100:00100000:3.0:1790100427.545167:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:10488:x1877056109455488:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 474us (981us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1790100427.545175:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00080000:1.0:1790100427.547121:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100427.557906:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100427.558096:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109455616 00000100:00100000:0.0:1790100427.558108:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109455616 00000100:00100000:0.0:1790100427.558169:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:0.0:1790100427.558181:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:10488:x1877056109455616:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:0.0:1790100427.558259:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558274:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558284:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558296:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558301:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558305:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558543:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558549:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558554:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100427.558589:0:11548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558607:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558634:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558642:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558648:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100427.558652:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558660:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558673:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100427.558676:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.558681:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558688:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd4f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558702:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558707:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558713:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558725:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100427.558728:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558734:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558743:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787edfa00) 00010000:00010000:0.0:1790100427.558746:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.558748:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558752:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd4f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558764:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558768:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558772:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558776:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100427.558778:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558784:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558801:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787edf800) 00010000:00010000:0.0:1790100427.558804:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.558807:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.558812:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd4ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100427.558889:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:10488:x1877056109455616:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 710us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.558898:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:3.0:1790100427.594939:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100427.595320:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109455872 00000100:00100000:1.0:1790100427.595332:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109455872 00000100:00100000:1.0:1790100427.595431:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:1.0:1790100427.595443:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:10491:x1877056109455872:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100427.595465:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100427.595487:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd506 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d0c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.595566:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.595581:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.595593:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.597365:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.597386:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.597400:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.597865:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.597876:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.597897:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100427.597910:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790100427.598010:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598018:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598024:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598030:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100427.598034:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598041:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598053:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:1.0:1790100427.598056:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100427.598062:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598068:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd50d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598079:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598084:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598096:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598100:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100427.598103:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598109:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598117:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6799df4000) 00010000:00010000:1.0:1790100427.598119:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100427.598122:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598128:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd514 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598177:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd506 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d0c expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598192:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d0c expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.598199:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:1.0:1790100427.598202:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100427.598204:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12600, rc 0) 00000100:00100000:1.0:1790100427.598286:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:10491:x1877056109455872:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2843us (3354us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1790100427.598305:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:2.0:1790100427.602524:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100427.605509:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109456000 00000100:00100000:3.0:1790100427.605525:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109456000 00000100:00100000:3.0:1790100427.605601:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:3.0:1790100427.605626:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:10491:x1877056109456000:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1790100427.605709:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.605728:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.605752:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.605783:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.605790:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.605798:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.605803:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100427.605808:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.605815:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.605829:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:3.0:1790100427.605833:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100427.605839:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.605845:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd529 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100427.605943:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:10491:x1877056109456000:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 333us (3428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100427.605952:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:1.0:1790100427.614084:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100427.614153:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109456256 00000100:00100000:2.0:1790100427.614165:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109456256 00000100:00100000:2.0:1790100427.614227:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1790100427.614238:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d679e03b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:10491:x1877056109456256:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1790100427.614718:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d679e03b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:10491:x1877056109456256:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 481us (644us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1790100427.614727:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:3.0:1790100427.648420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100427.649025:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109456512 00000100:00100000:0.0:1790100427.649039:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109456512 00000100:00100000:0.0:1790100427.649117:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:0.0:1790100427.649129:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:10012:x1877056109456512:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1790100427.649157:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100427.649180:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd530 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d13 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.649292:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.649309:0:11548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d0c expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.649320:0:11548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.649417:0:11548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d0c expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.649499:0:11548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d0c expref: 23 pid: 5841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100427.649515:0:11548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad534e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126250240:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100427.649798:0:11548:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0439c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100427.656262:0:11548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad534e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126250240:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100427.656295:0:11548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100427.662411:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100427.663094:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109456640 00000100:00100000:1.0:1790100427.663107:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109456640 00010000:00010000:1.0:1790100427.663154:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d0c expref: 24 pid: 5841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100427.663201:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:1.0:1790100427.663213:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:2357:x1877056109456640:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100427.663228:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100427.663235:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d0c expref: 24 pid: 5841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.663249:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d0c expref: 24 pid: 5841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.663272:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd51b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d0c expref: 24 pid: 5841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.663292:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:1.0:1790100427.663298:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.663308:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.663316:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.663473:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100427.663551:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:2357:x1877056109456640:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 340us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100427.663559:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00010000:00010000:3.0:1790100427.664908:0:11548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.664924:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100427.664946:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790100427.665273:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd530 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d13 expref: 24 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.665297:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d13 expref: 23 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.665307:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:2.0:1790100427.665310:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790100427.665313:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818000, rc 0) 00000100:00100000:2.0:1790100427.665435:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:10012:x1877056109456512:12345-192.168.201.18@tcp:101:bash.0 Request processed in 16306us (17023us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1790100427.665444:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:3.0:1790100427.667965:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100427.668034:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109456896 00000100:00100000:1.0:1790100427.668044:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109456896 00000100:00100000:1.0:1790100427.668096:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:1.0:1790100427.668105:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:10012:x1877056109456896:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:1.0:1790100427.668390:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.668409:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.668421:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100427.668473:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1790100427.668499:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8facd56 reply state 0000000053c4d8f1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100427.668509:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790100427.668553:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1790100427.669251:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:10012:x1877056109456896:12345-192.168.201.18@tcp:36:bash.0 Request processed in 1144us (1291us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1790100427.669261:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 89 00000020:00080000:0.0:1790100427.669266:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790100427.671391:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100427.671464:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109457024 00000100:00100000:2.0:1790100427.671476:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109457024 00000100:00100000:2.0:1790100427.671543:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:2.0:1790100427.671555:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:10012:x1877056109457024:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1790100427.671583:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100427.671604:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd54c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d1a expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.671811:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd54c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d1a expref: 28 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.671827:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd54c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d1a expref: 28 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.671847:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:2.0:1790100427.671851:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100427.671855:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142a00, rc 0) 00000100:00100000:2.0:1790100427.672010:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:10012:x1877056109457024:12345-192.168.201.18@tcp:101:bash.0 Request processed in 457us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100427.672018:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 90 00010000:00010000:3.0:1790100427.672226:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.672236:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.672244:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.672250:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100427.672255:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.672264:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.672277:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:3.0:1790100427.672280:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100427.672284:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.672290:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd545 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100427.676159:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100427.676245:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109457152 00000100:00100000:0.0:1790100427.676261:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109457152 00000100:00100000:0.0:1790100427.676419:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1790100427.676431:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:10012:x1877056109457152:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1790100427.676452:0:12004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100427.676477:0:12004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d21 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100427.676506:0:12004:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ab2c3c7, atime: 0x6ab2c3c6, ctime: 0x6ab2c3c7, blocks: 0xb 00010000:00010000:0.0:1790100427.676533:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1790100427.676538:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100427.676547:0:12004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d21 expref: 7 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.676585:0:12004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d21 expref: 7 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.676600:0:12004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818800, rc 0) 00000100:00100000:0.0:1790100427.676714:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:10012:x1877056109457152:12345-192.168.201.18@tcp:101:bash.0 Request processed in 284us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.676722:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00080000:1.0:1790100427.676972:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100427.680201:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100427.682727:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109457280 00000100:00100000:0.0:1790100427.682745:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109457280 00002000:00010000:0.0:1790100427.682797:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1790100427.682801:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67ad534e00 with x1877056109457280 ext(0->18446744073709551615) 00002000:00010000:0.0:1790100427.682815:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67ad534e00. 00000100:00100000:0.0:1790100427.682910:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:0.0:1790100427.682923:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109457280:12345-192.168.201.18@tcp:10:bash.0 00002000:00010000:0.0:1790100427.683248:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790100427.683252:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790100423 -> 1790100427 00002000:00010000:0.0:1790100427.683255:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1790100422 -> 1790100422 00002000:00010000:0.0:1790100427.683257:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790100423 -> 1790100427 00002000:00010000:0.0:1790100427.683259:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790100427.683341:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109457280:12345-192.168.201.18@tcp:10:bash.0 Request processed in 420us (3150us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790100427.683350:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00002000:00010000:0.0:1790100427.683354:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1790100427.683386:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67ad534e00 with x1877056109457280 ext(0->18446744073709551615) 00002000:00010000:0.0:1790100427.683394:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67ad534e00. 00000100:00100000:0.0:1790100427.757333:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100427.757473:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109457408 00000100:00100000:2.0:1790100427.757485:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109457408 00000100:00100000:2.0:1790100427.757552:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:2.0:1790100427.757564:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:10505:x1877056109457408:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1790100427.757704:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.757721:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.757734:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.757766:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.757774:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.757781:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758022:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758032:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758040:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100427.758081:0:11548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758091:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758107:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758114:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758120:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100427.758124:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758131:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758143:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:2.0:1790100427.758146:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100427.758150:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758156:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd55a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758175:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758179:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758184:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758189:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100427.758197:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758203:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758210:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787defa00) 00010000:00010000:2.0:1790100427.758212:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100427.758215:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758221:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd561 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758237:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758243:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758249:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758253:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100427.758256:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758261:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758267:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:2.0:1790100427.758270:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100427.758278:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100427.758283:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd568 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100427.758373:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:10505:x1877056109457408:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 811us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100427.758381:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:3.0:1790100427.809532:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100427.809733:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109457664 00000100:00100000:0.0:1790100427.809755:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109457664 00000100:00100000:0.0:1790100427.809819:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:0.0:1790100427.809830:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:10508:x1877056109457664:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100427.809854:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100427.809876:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd56f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d28 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.809955:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.809972:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.809984:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810002:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810010:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810017:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810287:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd584 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810304:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810311:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100427.810323:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790100427.810428:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810436:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810443:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810449:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100427.810454:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810463:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810476:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100427.810492:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.810499:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810506:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd576 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810520:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810532:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810538:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810543:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100427.810546:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810552:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810560:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787edfb00) 00010000:00010000:0.0:1790100427.810563:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.810565:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.810572:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd57d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.811180:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd56f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d28 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.811200:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd584 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d28 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.811208:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:0.0:1790100427.811211:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790100427.811223:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819000, rc 0) 00000100:00100000:0.0:1790100427.811296:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:10508:x1877056109457664:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1467us (1774us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1790100427.811305:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:0.0:1790100427.814502:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100427.814826:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109457792 00000100:00100000:1.0:1790100427.814838:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109457792 00000100:00100000:1.0:1790100427.814908:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:1.0:1790100427.814919:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:10508:x1877056109457792:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:1.0:1790100427.815021:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.815042:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d13 expref: 29 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.815050:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.815091:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d13 expref: 29 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.815105:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d13 expref: 29 pid: 11548 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100427.815120:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad539180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6711:1877056126250368:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100427.815225:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100427.818243:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad539180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6711:1877056126250368:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100427.818276:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100427.819774:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100427.819960:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109458048 00000100:00100000:2.0:1790100427.819970:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109458048 00000100:00100000:2.0:1790100427.820030:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:2.0:1790100427.820041:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+30:5593:x1877056109458048:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790100427.820395:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:5593:x1877056109458048:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 354us (627us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1790100427.820404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:1.0:1790100427.823476:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100427.823891:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109458176 00000100:00100000:0.0:1790100427.823904:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109458176 00010000:00010000:0.0:1790100427.823948:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d13 expref: 31 pid: 11548 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100427.824042:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:0.0:1790100427.824053:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad539180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:2357:x1877056109458176:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100427.824070:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100427.824077:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d13 expref: 31 pid: 11548 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.824091:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d13 expref: 31 pid: 11548 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.824115:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd537 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d13 expref: 31 pid: 11548 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.824132:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:0.0:1790100427.824137:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.824148:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.824169:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.824204:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100427.824268:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad539180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+30:2357:x1877056109458176:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 216us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100427.824276:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00010000:00010000:3.0:1790100427.824747:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.824757:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.824786:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.824793:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.824801:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.824807:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100427.824812:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.824819:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.824829:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:3.0:1790100427.824831:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100427.824842:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.824849:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100427.824905:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:10508:x1877056109457792:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 9987us (10427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100427.824912:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:1.0:1790100427.827410:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100427.827498:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109458432 00000100:00100000:3.0:1790100427.827510:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109458432 00000100:00100000:3.0:1790100427.827568:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:3.0:1790100427.827580:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:10508:x1877056109458432:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100427.827865:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+30:10508:x1877056109458432:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 287us (464us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1790100427.827874:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:1.0:1790100427.904044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100427.904129:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109458688 00000100:00100000:3.0:1790100427.904141:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109458688 00000100:00100000:3.0:1790100427.904205:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:3.0:1790100427.904216:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+30:10519:x1877056109458688:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1790100427.904241:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100427.904264:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd599 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d2f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904345:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904373:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904405:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904423:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904431:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904438:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904770:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd5ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904782:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904789:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100427.904801:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1790100427.904889:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904897:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904904:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904911:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100427.904921:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904930:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904945:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:3.0:1790100427.904948:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100427.904954:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904960:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904974:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904981:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904986:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904991:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100427.904993:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.904998:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.905005:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787ec1400) 00010000:00010000:3.0:1790100427.905007:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100427.905016:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.905022:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.905067:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd599 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d2f expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.905082:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d2f expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.905089:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:3.0:1790100427.905091:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100427.905094:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af400, rc 0) 00000100:00100000:3.0:1790100427.905170:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:10519:x1877056109458688:12345-192.168.201.18@tcp:101:cat.0 Request processed in 955us (1138us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1790100427.905177:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:1.0:1790100427.911727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100427.911825:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109458944 00000100:00100000:3.0:1790100427.911837:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109458944 00000100:00100000:3.0:1790100427.911897:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:3.0:1790100427.911908:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:10519:x1877056109458944:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:3.0:1790100427.912175:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+33:10519:x1877056109458944:12345-192.168.201.18@tcp:35:cat.0 Request processed in 269us (461us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1790100427.912183:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1790100427.940309:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100427.940445:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109459200 00000100:00100000:0.0:1790100427.940455:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109459200 00000100:00100000:0.0:1790100427.940921:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:0.0:1790100427.940934:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+33:10520:x1877056109459200:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:0.0:1790100427.941000:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790100427.941031:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd5ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d2f expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941054:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd584 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d28 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941068:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd54c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d1a expref: 31 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941083:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:0.0:1790100427.941094:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100427.941114:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941127:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941152:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941167:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941173:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941179:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941437:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941447:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.941454:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100427.942399:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1790100427.942410:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324511798666ns, next at 325511796157ns, rc = 0 00010000:00010000:0.0:1790100427.942471:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.942483:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.942492:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.942510:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.942517:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.942523:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.942971:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100427.942999:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943006:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943013:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943018:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100427.943023:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943030:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943042:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787edf200) 00010000:00010000:0.0:1790100427.943045:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790100427.943050:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943067:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd5ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943091:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943098:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943103:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943108:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100427.943112:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943119:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943126:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100427.943128:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100427.943131:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100427.943136:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd5bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100427.943146:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f820a35 reply state 0000000094d93bc4 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100427.943156:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100427.943260:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:10520:x1877056109459200:12345-192.168.201.18@tcp:36:rm.0 Request processed in 2326us (2959us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1790100427.943269:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 95 00010000:00010000:3.0:1790100427.948372:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100427.948393:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.948425:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100427.948429:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.948440:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.948460:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d6787edf200) 00010000:00010000:3.0:1790100427.948463:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790100427.948469:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.948485:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd5d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100427.948511:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100427.948513:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100427.948515:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100427.950665:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.950689:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.950697:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.950723:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100427.950728:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.950736:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.950755:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787edfb00) 00010000:00010000:1.0:1790100427.950758:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100427.950762:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100427.950768:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd5c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100427.999774:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.000011:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109459456 00000100:00100000:3.0:1790100428.000025:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109459456 00000100:00100000:3.0:1790100428.000098:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:3.0:1790100428.000110:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:10526:x1877056109459456:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1790100428.000136:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100428.000158:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd5d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d36 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.000288:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.000305:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.000332:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.000349:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.000368:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.000374:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100428.000994:0:6711:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1790100428.001173:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001183:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001192:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001228:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001235:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001241:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001248:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100428.001258:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001268:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001282:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:3.0:1790100428.001285:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100428.001291:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001298:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd5df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100428.001311:0:6711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfa61409 reply state 00000000160fdaca transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.001321:0:6711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790100428.001368:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd5d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d36 expref: 34 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001385:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d36 expref: 33 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.001393:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787ec1900) 00010000:00010000:3.0:1790100428.001395:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100428.001398:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae400, rc 0) 00000100:00100000:3.0:1790100428.001465:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+34:10526:x1877056109459456:12345-192.168.201.18@tcp:101:bash.0 Request processed in 1358us (1702us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1790100428.001474:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:2.0:1790100428.005762:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:3.0:1790100428.005917:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.005929:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.005937:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.005943:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100428.005948:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.005955:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.005971:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787ec1400) 00010000:00010000:3.0:1790100428.005975:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100428.005980:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.005986:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd5e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.007645:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109459584 00000100:00100000:0.0:1790100428.007660:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109459584 00000100:00100000:0.0:1790100428.007729:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:0.0:1790100428.007753:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109459584:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1790100428.007771:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.007793:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d3d expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100428.007821:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790100428.007842:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1790100428.007846:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100428.007856:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d3d expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.007876:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d3d expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.007889:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818400, rc 0) 00000100:00100000:0.0:1790100428.007957:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109459584:12345-192.168.201.18@tcp:101:bash.0 Request processed in 219us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.007965:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00080000:2.0:1790100428.008171:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100428.012963:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.013061:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109459712 00000100:00100000:0.0:1790100428.013072:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109459712 00000100:00100000:0.0:1790100428.013134:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:0.0:1790100428.013151:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:10526:x1877056109459712:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1790100428.013171:0:12004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.013190:0:12004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d44 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.013220:0:12004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d3d expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.013231:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100428.013236:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100428.013241:0:12004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 9 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.013277:0:12004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d3d expref: 9 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.013292:0:12004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d3d expref: 9 pid: 6689 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.013307:0:12004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12004:1877056126250496:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100428.013444:0:12004:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100428.016818:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.016979:0:12004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12004:1877056126250496:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100428.017019:0:12004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 9 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.017061:0:12004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818200, rc 0) 00000100:00100000:0.0:1790100428.017132:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:10526:x1877056109459712:12345-192.168.201.18@tcp:101:bash.0 Request processed in 3982us (4179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.017141:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:3.0:1790100428.017274:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109459840 00000100:00100000:3.0:1790100428.017283:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109459840 00010000:00010000:3.0:1790100428.017320:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d3d expref: 9 pid: 6689 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.018762:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:2.0:1790100428.018788:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2357:x1877056109459840:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100428.018813:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100428.018847:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d3d expref: 9 pid: 6689 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.018866:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d3d expref: 9 pid: 6689 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.018920:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefd5fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d3d expref: 9 pid: 6689 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.018939:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100428.018944:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100428.018953:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.018966:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.019010:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.019025:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1877056126250624:192.168.201.18@tcp:105: 00000100:00100000:2.0:1790100428.019108:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b25eae40 going to sleep for 11 seconds 00000100:00100000:1.0:1790100428.027120:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.027406:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109460096 00000100:00100000:3.0:1790100428.027418:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109460096 00000100:00100000:3.0:1790100428.027486:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:3.0:1790100428.027513:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+33:10526:x1877056109460096:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:3.0:1790100428.027964:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+34:10526:x1877056109460096:12345-192.168.201.18@tcp:35:bash.0 Request processed in 452us (855us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1790100428.027972:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:2.0:1790100428.029089:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b80e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1877056126250624:192.168.201.18@tcp:105: 00010000:00010000:2.0:1790100428.029114:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100428.029164:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109459840:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 10389us (12355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100428.029174:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00010000:00010000:0.0:1790100428.070005:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100428.184717:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.184822:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109460224 00000100:00100000:0.0:1790100428.184834:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109460224 00000100:00100000:0.0:1790100428.184904:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:0.0:1790100428.184915:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+34:10542:x1877056109460224:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100428.184939:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.185005:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd609 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.185073:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.185087:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.185098:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100428.185132:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790100428.185136:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100428.185152:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.185176:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d4b expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.185214:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d4b expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.185222:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100428.185225:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100428.185229:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818a00, rc 0) 00000100:00100000:0.0:1790100428.185296:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:10542:x1877056109460224:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 383us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.185303:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:3.0:1790100428.191456:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.191546:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109460480 00000100:00100000:0.0:1790100428.191559:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109460480 00000100:00100000:3.0:1790100428.191775:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:3.0:1790100428.191789:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:10542:x1877056109460480:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100428.191813:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100428.191836:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd617 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d52 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.191976:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd61e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.191991:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd61e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.192005:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd61e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100428.192017:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790100428.192155:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd617 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d52 expref: 38 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.192174:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd61e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d52 expref: 37 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.192183:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787ec1900) 00010000:00010000:3.0:1790100428.192192:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100428.192196:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae000, rc 0) 00000100:00100000:3.0:1790100428.192266:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+37:10542:x1877056109460480:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 481us (820us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1790100428.192273:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:1.0:1790100428.197089:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.197129:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100428.197204:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109460864 00000100:00100000:2.0:1790100428.197216:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109460864 00000100:00100000:2.0:1790100428.197295:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:2.0:1790100428.197320:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+37:2358:x1877056109460864:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100428.197339:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100428.197375:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd61e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d52 expref: 37 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.197396:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787ec1900) 00010000:00010000:2.0:1790100428.197401:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100428.197463:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:2358:x1877056109460864:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 146us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100428.197472:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1790100428.198031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109460736 00000100:00100000:0.0:1790100428.198038:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109460736 00000100:00100000:0.0:1790100428.198075:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:0.0:1790100428.198082:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:10542:x1877056109460736:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100428.198102:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.198117:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd62c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d59 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.198207:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd633 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.198221:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.198231:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100428.198253:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790100428.198377:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd62c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d59 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.198395:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d59 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.198402:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787ec1900) 00010000:00010000:0.0:1790100428.198405:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790100428.198408:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819200, rc 0) 00000100:00100000:0.0:1790100428.198444:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:10542:x1877056109460736:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 362us (1367us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1790100428.198451:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:1.0:1790100428.206821:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.206908:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109460992 00000100:00100000:0.0:1790100428.206919:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109460992 00000100:00100000:0.0:1790100428.206979:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1790100428.206988:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2359:x1877056109460992:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:0.0:1790100428.207032:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.207055:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.207064:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100428.207069:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100428.207074:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.207120:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.207134:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 8 pid: 12004 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.207149:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877056126250752:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100428.207236:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100428.210270:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.210367:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109461120 00000100:00100000:3.0:1790100428.210376:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109461120 00002000:00100000:3.0:1790100428.210429:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d67bf975500 x1877056109461120/t0(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:724/0 lens 504/0 e 0 to 0 dl 1790100439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790100428.210440:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf975500 with x1877056109461120 ext(0->8) 00010000:00010000:3.0:1790100428.210451:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 9 pid: 12004 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.210470:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 9 pid: 12004 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100428.210488:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d67bf975500 00000100:00100000:3.0:1790100428.210521:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1790100428.210532:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2358:x1877056109461120:12345-192.168.201.18@tcp:4:lfs.0 00000100:00100000:3.0:1790100428.211128:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:2358:x1877056109461120:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 596us (865us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790100428.211137:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00002000:00100000:3.0:1790100428.211145:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d67bf975500 x1877056109461120/t4294967302(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:724/0 lens 504/448 e 0 to 0 dl 1790100439 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790100428.211152:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf975500 with x1877056109461120 ext(0->8) 00010000:00010000:3.0:1790100428.211165:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 11 pid: 12004 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.211179:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 11 pid: 12004 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100428.211186:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d67bf975500 00000100:00100000:0.0:1790100428.211646:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad537800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877056126250752:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100428.211673:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.214722:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.214885:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109461248 00000100:00100000:0.0:1790100428.214898:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109461248 00010000:00010000:0.0:1790100428.214948:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 11 pid: 12004 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.214997:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:0.0:1790100428.215008:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:2360:x1877056109461248:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100428.215024:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790100428.215045:0:12013:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790100428.215048:0:12013:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790100427 00002000:00010000:0.0:1790100428.215050:0:12013:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790100427 00002000:00010000:0.0:1790100428.215052:0:12013:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790100427 00010000:00010000:0.0:1790100428.215076:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 11 pid: 12004 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.215090:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 11 pid: 12004 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.215117:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefd602 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d44 expref: 11 pid: 12004 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.215135:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100428.215139:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100428.215144:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.215154:0:12013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.215194:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100428.215260:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:2360:x1877056109461248:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 253us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.215268:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00010000:00010000:1.0:1790100428.215344:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.215363:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.215395:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.215403:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.215412:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.215420:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100428.215424:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.215434:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.215447:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.215454:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefd641 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.215503:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2359:x1877056109460992:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 8517us (8692us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.215511:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:1.0:1790100428.218790:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.218969:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109461504 00000100:00100000:3.0:1790100428.218981:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109461504 00000100:00100000:3.0:1790100428.219047:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:3.0:1790100428.219058:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d679e03a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:10542:x1877056109461504:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:3.0:1790100428.219127:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d59 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100428.219387:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1790100428.219433:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1790100428.220071:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1790100428.220131:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.220147:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d36 expref: 42 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.220156:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.220194:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d36 expref: 42 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.220227:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d36 expref: 42 pid: 6711 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.220244:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1877056126250880:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100428.220396:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45300 going to sleep for 11 seconds 00000100:00100000:1.0:1790100428.224433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100428.225057:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109461632 00000100:00100000:2.0:1790100428.225068:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109461632 00010000:00010000:2.0:1790100428.225117:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d36 expref: 43 pid: 6711 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.225154:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:2.0:1790100428.225160:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:2357:x1877056109461632:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100428.225174:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100428.225179:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d36 expref: 43 pid: 6711 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.225189:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d36 expref: 43 pid: 6711 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.225208:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787ec1900) 00010000:00010000:2.0:1790100428.225212:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.225233:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.225240:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.225254:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100428.225332:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:2357:x1877056109461632:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 171us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100428.225337:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00010000:00010000:3.0:1790100428.225502:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd5ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d36 expref: 42 pid: 6711 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.225519:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1877056126250880:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100428.225540:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.225548:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.225552:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100428.225710:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1790100428.226158:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1790100428.226272:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126251008:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790100428.226330:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100428.226433:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790100428.228241:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126251008 00000100:00100000:1.0:1790100428.228256:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126251008 00000100:00100000:1.0:1790100428.228336:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790100428.228356:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1877056126251008:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790100428.228602:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126251008:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790100428.229178:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1790100428.229262:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126251136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790100428.229314:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100428.229385:0:5847:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1790100428.229392:0:5847:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1790100428.229503:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100428.229529:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126251136 00000100:00100000:3.0:1790100428.229535:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126251136 00000100:00100000:3.0:1790100428.229655:0:12069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100428.229664:0:12069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5844:x1877056126251136:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1790100428.230169:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100428.230319:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1877056126251008:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.230331:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100428.230680:0:12069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5844:x1877056126251136:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1016us (1364us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1790100428.230691:0:12069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100428.230890:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126251136:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790100428.230961:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1790100428.231007:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.231018:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.231025:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.231031:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100428.231037:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.231045:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.231063:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787ec1900) 00010000:00010000:3.0:1790100428.231066:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790100428.231071:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.231092:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd648 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100428.231296:0:5844:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790100428.231435:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1790100428.231447:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324800836073ns, next at 325800833903ns, rc = 0 00000001:00080000:3.0:1790100428.231454:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1790100428.231548:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787ec1900) 00010000:00010000:3.0:1790100428.231552:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790100428.231559:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd633 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d59 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.231770:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d679e03a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+45:10542:x1877056109461504:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 12714us (12990us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1790100428.231778:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000020:00080000:3.0:1790100428.231783:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790100428.234862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100428.234965:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109461760 00000100:00100000:2.0:1790100428.234980:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109461760 00000100:00100000:2.0:1790100428.235068:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:2.0:1790100428.235078:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+45:10542:x1877056109461760:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100428.235104:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100428.235125:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd64f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d60 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.235182:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd64f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d60 expref: 46 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.235197:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd64f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d60 expref: 46 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.235233:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:2.0:1790100428.235236:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100428.235240:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142000, rc 0) 00000100:00100000:2.0:1790100428.235297:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+46:10542:x1877056109461760:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 220us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100428.235304:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:2.0:1790100428.238722:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.238971:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109462016 00000100:00100000:1.0:1790100428.238982:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109462016 00000100:00100000:1.0:1790100428.239044:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:1.0:1790100428.239056:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+46:10542:x1877056109462016:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1790100428.239307:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:10542:x1877056109462016:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 254us (595us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1790100428.239315:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1790100428.324203:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.324313:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109462144 00000100:00100000:1.0:1790100428.324325:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109462144 00000100:00100000:1.0:1790100428.324398:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:1.0:1790100428.324409:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:10552:x1877056109462144:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:1.0:1790100428.324510:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324529:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324541:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324575:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324583:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324602:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324746:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324756:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324763:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100428.324814:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324828:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324835:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324843:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324849:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100428.324853:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324867:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324881:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:1.0:1790100428.324884:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100428.324889:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324895:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd656 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324911:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324916:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324922:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324927:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100428.324929:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324936:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324942:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6799df4000) 00010000:00010000:1.0:1790100428.324945:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100428.324948:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324963:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd65d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324978:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324983:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324987:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.324992:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100428.324994:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.325000:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.325007:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:1.0:1790100428.325010:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100428.325013:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.325017:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefd664 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.325100:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:10552:x1877056109462144:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 691us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.325109:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:2.0:1790100428.356521:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.356646:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109462400 00000100:00100000:0.0:1790100428.356658:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109462400 00000100:00100000:0.0:1790100428.356730:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:0.0:1790100428.356753:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:10555:x1877056109462400:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100428.356778:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.356819:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd66b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d67 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.356911:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.356926:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.356938:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.356953:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.356960:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.356966:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357092:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357101:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357107:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100428.357119:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790100428.357216:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357233:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357240:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357246:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100428.357250:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357257:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357269:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100428.357272:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100428.357277:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357283:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefd672 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357299:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357304:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357310:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357315:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100428.357323:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357330:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357338:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787edf700) 00010000:00010000:0.0:1790100428.357340:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100428.357343:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357359:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357404:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd66b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d67 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357417:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d67 expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.357425:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100428.357427:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100428.357430:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819000, rc 0) 00000100:00100000:0.0:1790100428.357499:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+49:10555:x1877056109462400:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 760us (992us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1790100428.357507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:2.0:1790100428.360531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.360608:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109462528 00000100:00100000:0.0:1790100428.360637:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109462528 00000100:00100000:0.0:1790100428.360699:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:0.0:1790100428.360709:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+49:10555:x1877056109462528:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:0.0:1790100428.360821:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.360834:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.360843:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.360866:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.360871:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.360876:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.360880:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100428.360882:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.360887:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.360896:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100428.360898:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790100428.360901:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.360905:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd68e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.360989:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+49:10555:x1877056109462528:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 281us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.360997:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:1.0:1790100428.363681:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.363952:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109462784 00000100:00100000:3.0:1790100428.363962:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109462784 00000100:00100000:3.0:1790100428.364013:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:3.0:1790100428.364022:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+49:10555:x1877056109462784:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100428.364402:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:10555:x1877056109462784:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 380us (730us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1790100428.364411:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:2.0:1790100428.443649:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.443782:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109463040 00000100:00100000:0.0:1790100428.443794:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109463040 00000100:00100000:0.0:1790100428.443863:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 104 00000100:00100000:0.0:1790100428.443875:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:10565:x1877056109463040:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1790100428.443899:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.443903:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790100428.443932:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd610 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d4b expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.443955:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100428.443961:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100428.443974:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd695 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d6e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.444078:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.444093:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d67 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.444101:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.444137:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d67 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.444166:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d67 expref: 50 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.444182:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad535500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1877056126251264:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100428.444315:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100428.447939:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.448043:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad535500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1877056126251264:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100428.448073:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.448136:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109463168 00000100:00100000:3.0:1790100428.448145:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109463168 00010000:00010000:3.0:1790100428.448185:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d67 expref: 51 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.448243:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:3.0:1790100428.448253:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:2358:x1877056109463168:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100428.448270:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100428.448278:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d67 expref: 51 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.448291:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d67 expref: 51 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.448316:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd680 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d67 expref: 51 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.448338:0:12013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:3.0:1790100428.448354:0:12013:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.448364:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.448372:0:12013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.448401:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100428.448546:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.448554:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100428.448572:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790100428.448830:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd695 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d6e expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.448848:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d6e expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.448855:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100428.448858:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790100428.448861:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819200, rc 0) 00000100:00100000:3.0:1790100428.449031:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:2358:x1877056109463168:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 777us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.449040:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:0.0:1790100428.450099:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:10565:x1877056109463040:12345-192.168.201.18@tcp:101:bash.0 Request processed in 6220us (6455us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1790100428.450123:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 104 00000100:00100000:1.0:1790100428.453082:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.453156:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109463424 00000100:00100000:3.0:1790100428.453182:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109463424 00000100:00100000:3.0:1790100428.453240:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 105 00000100:00100000:3.0:1790100428.453250:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:10565:x1877056109463424:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:3.0:1790100428.453561:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.453587:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.453600:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100428.453680:0:6711:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1790100428.453704:0:6711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094fc9347 reply state 00000000a3ac9104 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.453714:0:6711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100428.454012:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10565:x1877056109463424:12345-192.168.201.18@tcp:36:bash.0 Request processed in 761us (941us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1790100428.454020:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 105 00000020:00080000:3.0:1790100428.454025:0:6711:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790100428.460926:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:0.0:1790100428.461043:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.461058:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.461066:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.461073:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100428.461078:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.461087:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.461105:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100428.461108:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100428.461114:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.461120:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.461177:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109463552 00000100:00100000:2.0:1790100428.461188:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109463552 00000100:00100000:2.0:1790100428.461278:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:2.0:1790100428.461289:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10565:x1877056109463552:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1790100428.461309:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100428.461329:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefd6b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d75 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.461424:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.461440:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d6e expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.461449:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.461506:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d6e expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.461521:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d6e expref: 53 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.461536:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126251392:192.168.201.18@tcp:104: 00000100:00100000:2.0:1790100428.461654:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b25ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100428.464454:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.464787:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109463680 00000100:00100000:3.0:1790100428.464797:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109463680 00010000:00010000:3.0:1790100428.464837:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d6e expref: 54 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.464876:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:3.0:1790100428.464886:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:2357:x1877056109463680:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100428.464899:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100428.464905:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d6e expref: 54 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.464931:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d6e expref: 54 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.464952:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:3.0:1790100428.464958:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.464969:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.464978:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.464994:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100428.465044:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:2357:x1877056109463680:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 159us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.465052:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00010000:00010000:1.0:1790100428.466355:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd69c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d6e expref: 53 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.466379:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b83800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126251392:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100428.466403:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.466413:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.466419:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100428.466537:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790100428.466542:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100428.466567:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.466716:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefd6b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d75 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.466799:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d75 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.466809:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:1.0:1790100428.466812:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100428.466832:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142800, rc 0) 00000100:00100000:1.0:1790100428.466937:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10565:x1877056109463552:12345-192.168.201.18@tcp:101:bash.0 Request processed in 5648us (6021us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.466946:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:2.0:1790100428.470138:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.470224:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109463936 00000100:00100000:0.0:1790100428.470234:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109463936 00000100:00100000:0.0:1790100428.470315:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1790100428.470325:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:10565:x1877056109463936:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:0.0:1790100428.470594:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10565:x1877056109463936:12345-192.168.201.18@tcp:35:bash.0 Request processed in 270us (466us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1790100428.470641:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1790100428.531854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.536452:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109464064 00000100:00100000:3.0:1790100428.536472:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109464064 00000100:00100000:0.0:1790100428.536857:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:0.0:1790100428.536871:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:10571:x1877056109464064:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100428.536902:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.536931:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd6bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d7c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.537364:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd6c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.537383:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.537400:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100428.537457:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790100428.537461:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100428.537484:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.537516:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefd6bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d7c expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.537544:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d7c expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.537572:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:0.0:1790100428.537939:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100428.537946:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819a00, rc 0) 00000100:00100000:0.0:1790100428.538034:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10571:x1877056109464064:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1164us (6190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.538043:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:2.0:1790100428.541657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.541759:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109464192 00000100:00100000:3.0:1790100428.541775:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109464192 00000100:00100000:3.0:1790100428.541863:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 108 00000100:00100000:3.0:1790100428.541876:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10571:x1877056109464192:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100428.541903:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100428.541931:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd6cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d83 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542032:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542073:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542088:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542108:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542115:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542122:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542739:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd6e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542753:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542763:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100428.542812:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790100428.542818:0:6711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100428.542841:0:6711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542856:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542882:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542889:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542897:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542904:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100428.542910:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542917:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542932:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:3.0:1790100428.542935:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100428.542940:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542948:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd6d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542965:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542971:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542978:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542989:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100428.542993:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.542999:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.543008:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787ec1900) 00010000:00010000:3.0:1790100428.543010:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100428.543013:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.543019:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd6db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.543062:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefd6cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d83 expref: 56 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.543077:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d83 expref: 55 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.543085:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:3.0:1790100428.543087:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100428.543090:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae000, rc 0) 00000100:00100000:3.0:1790100428.543760:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10571:x1877056109464192:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1879us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.543772:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 108 00000100:00100000:3.0:1790100428.551073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.551140:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100428.551295:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109464576 00000100:00100000:2.0:1790100428.551308:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109464576 00000100:00100000:2.0:1790100428.551440:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1790100428.551453:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:2357:x1877056109464576:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100428.551473:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100428.551507:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefd6e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d83 expref: 55 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.551531:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:2.0:1790100428.551536:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100428.551659:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:2357:x1877056109464576:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 208us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100428.551668:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:1.0:1790100428.552824:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109464448 00000100:00100000:1.0:1790100428.552842:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109464448 00000100:00100000:1.0:1790100428.552911:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 109 00000100:00100000:1.0:1790100428.552922:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10571:x1877056109464448:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100428.552948:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100428.552972:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d8a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.553077:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.553092:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d75 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.553102:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.553139:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d75 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.553154:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d75 expref: 55 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.553171:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126251520:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100428.553289:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f82900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100428.564041:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.564090:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109464704 00000100:00100000:1.0:1790100428.564102:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109464704 00010000:00010000:1.0:1790100428.564153:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d75 expref: 56 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.564202:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:1.0:1790100428.564215:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:2357:x1877056109464704:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100428.564231:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100428.564238:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d75 expref: 56 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.564254:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d75 expref: 56 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.564279:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:1.0:1790100428.564286:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.564297:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.564306:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.564325:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100428.564336:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd6b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d75 expref: 56 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.564384:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126251520:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100428.564413:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.564425:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.564430:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100428.564511:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790100428.564780:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d8a expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.565638:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:2357:x1877056109464704:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1394us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.565652:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00010000:00010000:3.0:1790100428.565917:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d8a expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.565932:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:3.0:1790100428.565935:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100428.565940:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13000, rc 0) 00000100:00100000:3.0:1790100428.566016:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10571:x1877056109464448:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 13095us (14959us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1790100428.566028:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 109 00000100:00100000:3.0:1790100428.573298:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.573901:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109464960 00000100:00100000:0.0:1790100428.573919:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109464960 00000100:00100000:0.0:1790100428.574002:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1790100428.574017:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10571:x1877056109464960:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:0.0:1790100428.574036:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100428.574065:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd64f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d60 expref: 55 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.574090:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100428.574095:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100428.574167:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10571:x1877056109464960:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 155us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.574176:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1790100428.576768:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.577457:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109465088 00000100:00100000:3.0:1790100428.577495:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109465088 00000100:00100000:3.0:1790100428.577578:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 110 00000100:00100000:3.0:1790100428.577590:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10571:x1877056109465088:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:1.0:1790100428.578047:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.578078:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.578092:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100428.578351:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1790100428.578477:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10571:x1877056109465088:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 887us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.578487:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 110 00000001:00080000:3.0:1790100428.582676:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1790100428.582705:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1790100428.582710:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1790100428.584797:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.585195:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109465216 00000100:00100000:1.0:1790100428.585208:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109465216 00000100:00100000:1.0:1790100428.585287:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:1.0:1790100428.585301:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:10571:x1877056109465216:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100428.585331:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100428.585374:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd705 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d91 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.585455:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.585468:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd705 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d91 expref: 55 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.585493:0:6711:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.585508:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd705 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d91 expref: 55 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.585545:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:1.0:1790100428.585549:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100428.585554:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd705 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d91 expref: 55 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.585562:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13800, rc 0) 00000100:00100000:1.0:1790100428.585669:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10571:x1877056109465216:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 371us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.585677:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 111 00000040:00080000:0.0:1790100428.709988:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100428.710001:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100428.710070:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1790100428.710080:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100428.710224:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad536d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126251648:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790100428.710363:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100428.715647:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad536d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126251648:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790100428.719197:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.719508:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109465344 00000100:00100000:3.0:1790100428.719519:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109465344 00000100:00100000:3.0:1790100428.719591:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:3.0:1790100428.719602:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10572:x1877056109465344:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790100428.719674:0:5841:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790100428.719785:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10572:x1877056109465344:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 185us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.719794:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:3.0:1790100428.729798:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.730098:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109465472 00000100:00100000:1.0:1790100428.730118:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109465472 00000100:00100000:1.0:1790100428.730209:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:1.0:1790100428.730358:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10572:x1877056109465472:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790100428.730533:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.730556:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.730571:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740064:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740091:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740126:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740161:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740172:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740178:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100428.740224:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790100428.740229:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100428.740244:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740255:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740263:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740270:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740276:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100428.740281:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740289:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740310:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:1.0:1790100428.740313:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100428.740320:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740327:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd70c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740357:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740364:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740370:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740375:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100428.740378:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740384:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740393:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d6799df4000) 00010000:00010000:1.0:1790100428.740395:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100428.740398:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740404:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd713 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740429:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740436:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740442:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740447:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100428.740450:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740456:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.740463:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:1.0:1790100428.740466:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100428.740484:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.744807:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd71a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.745004:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10572:x1877056109465472:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 14649us (15211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.745016:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 113 00000100:00100000:0.0:1790100428.753162:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.753418:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109465728 00000100:00100000:1.0:1790100428.753430:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109465728 00000100:00100000:1.0:1790100428.753507:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:1.0:1790100428.753535:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:10572:x1877056109465728:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100428.753560:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100428.753581:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd721 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d98 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.753739:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.753756:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.753769:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100428.753782:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790100428.753887:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.753896:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.753903:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.753910:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100428.753915:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.753922:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.753934:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:1.0:1790100428.753943:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100428.753949:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.753956:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd728 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.754001:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd721 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d98 expref: 57 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.754011:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:1.0:1790100428.754013:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100428.754017:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd721 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d98 expref: 57 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.754027:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12a00, rc 0) 00000100:00100000:1.0:1790100428.754098:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:10572:x1877056109465728:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 564us (943us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1790100428.754106:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 114 00000100:00100000:2.0:1790100428.762175:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.762367:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109465856 00000100:00100000:3.0:1790100428.762378:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109465856 00000100:00100000:3.0:1790100428.762437:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:3.0:1790100428.762447:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:10572:x1877056109465856:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790100428.762480:0:5842:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790100428.762584:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae66b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:10572:x1877056109465856:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 138us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.762592:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:3.0:1790100428.779119:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.779323:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109466112 00000100:00100000:1.0:1790100428.779335:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109466112 00000100:00100000:1.0:1790100428.779443:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:1.0:1790100428.779457:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:10572:x1877056109466112:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100428.779497:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100428.779500:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790100428.779528:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd6c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d7c expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.779553:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:1.0:1790100428.779574:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100428.779591:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd736 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64d9f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790100428.780101:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1790100428.780354:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd73d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.780372:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd73d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.780383:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd73d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.780445:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd736 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d9f expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.780462:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd73d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d9f expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.780471:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:1.0:1790100428.780474:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100428.780476:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13e00, rc 0) 00000100:00100000:1.0:1790100428.780562:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:10572:x1877056109466112:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1108us (1454us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1790100428.780571:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:0.0:1790100428.792156:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.792281:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109466368 00000100:00100000:1.0:1790100428.792295:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109466368 00000100:00100000:1.0:1790100428.792388:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:1.0:1790100428.792403:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:10572:x1877056109466368:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790100428.792487:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100428.792519:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd73d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d9f expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.792541:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:1.0:1790100428.792553:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100428.792579:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.792595:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.792606:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.792725:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793003:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793012:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793094:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793102:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793109:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793125:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100428.793129:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793138:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793149:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:1.0:1790100428.793152:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100428.793156:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793163:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd74b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793173:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793179:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793185:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793190:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100428.793193:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793199:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793217:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x10986f40 (ffff8d6799df4300) 00010000:00010000:1.0:1790100428.793219:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100428.793221:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.793227:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd752 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x10986f40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.793331:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:10572:x1877056109466368:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 930us (1188us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790100428.793430:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 117 00000100:00100000:2.0:1790100428.803929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.806701:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109466496 00000100:00100000:0.0:1790100428.806718:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109466496 00000100:00100000:0.0:1790100428.806808:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:0.0:1790100428.806819:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:10572:x1877056109466496:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100428.806841:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.806874:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd759 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64da6 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.806911:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.806925:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.806937:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.807038:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd759 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64da6 expref: 58 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.807060:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64da6 expref: 57 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.807069:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:0.0:1790100428.807077:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790100428.807081:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818000, rc 0) 00000100:00100000:0.0:1790100428.807149:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:10572:x1877056109466496:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 331us (3235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.807157:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 118 00000100:00100000:3.0:1790100428.813064:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.813406:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109466752 00000100:00100000:1.0:1790100428.813418:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109466752 00000100:00100000:1.0:1790100428.813479:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:1.0:1790100428.813489:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:10572:x1877056109466752:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790100428.813582:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.813601:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.813899:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100428.814288:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1790100428.814535:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005313303c reply state 00000000072d6a7c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.814546:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100428.814886:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:10572:x1877056109466752:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1395us (1828us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1790100428.814896:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 119 00000100:00100000:1.0:1790100428.822460:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100428.822590:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109466880 00000100:00100000:2.0:1790100428.822602:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109466880 00010000:00010000:3.0:1790100428.822703:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.822708:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 120 00010000:00010000:3.0:1790100428.822720:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.822726:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:10572:x1877056109466880:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100428.822734:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.822742:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100428.822746:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.822754:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.822770:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:3.0:1790100428.822773:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790100428.822778:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.822786:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd767 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.822888:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100428.822908:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64dad expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.822972:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dad expref: 59 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.822988:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dad expref: 59 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.823007:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:2.0:1790100428.823010:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100428.823013:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143a00, rc 0) 00000100:00100000:2.0:1790100428.823083:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:10572:x1877056109466880:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 362us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100428.823106:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:0.0:1790100428.825780:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.825901:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109467008 00000100:00100000:1.0:1790100428.825912:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109467008 00000100:00100000:1.0:1790100428.825971:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:1.0:1790100428.825983:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2360:x1877056109467008:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790100428.826313:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2360:x1877056109467008:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 332us (543us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790100428.826321:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:3.0:1790100428.832114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.832234:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109467264 00000100:00100000:1.0:1790100428.832246:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109467264 00000100:00100000:1.0:1790100428.832311:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:1.0:1790100428.832320:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:10572:x1877056109467264:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790100428.833001:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:10572:x1877056109467264:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 677us (892us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1790100428.833010:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:2.0:1790100428.837151:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.837231:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109467520 00000100:00100000:3.0:1790100428.837242:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109467520 00000100:00100000:3.0:1790100428.837306:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:3.0:1790100428.837318:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:10572:x1877056109467520:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790100428.837782:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:10572:x1877056109467520:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 465us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.837808:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:2.0:1790100428.846731:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.847076:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109467648 00000100:00100000:0.0:1790100428.847088:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109467648 00000100:00100000:0.0:1790100428.847150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:0.0:1790100428.847160:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:10572:x1877056109467648:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100428.847188:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100428.847214:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd775 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64db4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.847289:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd77c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.847304:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.847316:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100428.847362:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100428.847382:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.847408:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefd775 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64db4 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.847778:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd77c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64db4 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.847787:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:0.0:1790100428.847790:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790100428.847794:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819c00, rc 0) 00000100:00100000:0.0:1790100428.847896:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:10572:x1877056109467648:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 737us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.847905:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 122 00000100:00100000:0.0:1790100428.851397:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.851543:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109467776 00000100:00100000:1.0:1790100428.851554:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109467776 00000100:00100000:1.0:1790100428.851923:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:1.0:1790100428.851934:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2357:x1877056109467776:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100428.851955:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100428.851977:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64dbb expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100428.852005:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c3cc, blocks: 0x1 00010000:00010000:1.0:1790100428.852027:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=325s v=(0 0) 00010000:00010000:1.0:1790100428.852032:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100428.852041:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dbb expref: 10 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.852059:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dbb expref: 10 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.852087:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13e00, rc 0) 00000100:00100000:1.0:1790100428.852151:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:2357:x1877056109467776:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 219us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.852158:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:2.0:1790100428.855264:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.855363:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109468032 00000100:00100000:0.0:1790100428.855377:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109468032 00000100:00100000:0.0:1790100428.855481:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:0.0:1790100428.855493:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:10572:x1877056109468032:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790100428.855635:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:10572:x1877056109468032:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 122us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.855642:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 123 00000100:00100000:2.0:1790100428.861169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.861244:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109468160 00000100:00100000:1.0:1790100428.861257:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109468160 00000100:00100000:1.0:1790100428.861320:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:1.0:1790100428.861332:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:10572:x1877056109468160:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100428.861360:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100428.861377:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64dc2 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.861411:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dbb expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.861420:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100428.861423:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100428.861429:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.861473:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dbb expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.861489:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dbb expref: 11 pid: 6690 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.861518:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1877056126251776:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100428.861642:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f82f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100428.865477:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.865601:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1877056126251776:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100428.865673:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.865693:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12c00, rc 0) 00000100:00100000:1.0:1790100428.865771:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:10572:x1877056109468160:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 4441us (4611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.865782:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:0.0:1790100428.865981:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109468288 00000100:00100000:0.0:1790100428.865990:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109468288 00010000:00010000:0.0:1790100428.866030:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dbb expref: 11 pid: 6690 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.866064:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:0.0:1790100428.866072:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:2358:x1877056109468288:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100428.866119:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100428.866144:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dbb expref: 11 pid: 6690 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.866158:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dbb expref: 11 pid: 6690 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.866182:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bd1155d/0x31a8f3fdeeefd783 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dbb expref: 11 pid: 6690 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.866197:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100428.866201:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100428.866210:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.866221:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.866255:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.866270:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad537480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1877056126251904:192.168.201.18@tcp:105: 00000100:00100000:0.0:1790100428.866321:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100428.871057:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad537480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1877056126251904:192.168.201.18@tcp:105: 00010000:00010000:0.0:1790100428.871087:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100428.871167:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:2358:x1877056109468288:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 5095us (5699us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100428.871179:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:2.0:1790100428.873146:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.873228:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109468416 00000100:00100000:0.0:1790100428.873240:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109468416 00002000:00100000:0.0:1790100428.873294:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d6788c7d880 x1877056109468416/t0(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:724/0 lens 504/0 e 0 to 0 dl 1790100439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790100428.873305:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6788c7d880 with x1877056109468416 ext(0->12) 00002000:00010000:0.0:1790100428.873311:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6788c7d880 00000100:00100000:0.0:1790100428.873351:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:0.0:1790100428.873360:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:2357:x1877056109468416:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790100428.873877:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:2357:x1877056109468416:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 517us (738us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790100428.873885:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00002000:00100000:0.0:1790100428.873893:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d6788c7d880 x1877056109468416/t4294967308(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:724/0 lens 504/448 e 0 to 0 dl 1790100439 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790100428.873901:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d6788c7d880 with x1877056109468416 ext(0->12) 00002000:00010000:0.0:1790100428.873905:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d6788c7d880 00000100:00100000:3.0:1790100428.878307:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.878429:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109468544 00000100:00100000:1.0:1790100428.878440:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109468544 00000100:00100000:1.0:1790100428.878600:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:1.0:1790100428.878658:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:10572:x1877056109468544:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790100428.922835:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000004:00080000:0.0:1790100428.922854:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1790100428.922877:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1790100428.922887:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1790100428.922931:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1790100428.922946:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d6784e45d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1790100428.922951:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ad0abf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d6784e45e40 00000020:00080000:0.0:1790100428.922971:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ad0aba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d67bf3bf400 00000020:00080000:0.0:1790100428.923005:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d67a9735c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1790100428.923008:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ad0ab200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d67a9735540 00000020:00080000:0.0:1790100428.923011:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ad0ab800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d67bb9d1800 00000020:00080000:0.0:1790100428.923035:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1790100428.923240:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790100428.923366:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126252032:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790100428.923434:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100428.923649:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126252160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790100428.923679:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100428.923758:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126252032 00000100:00100000:1.0:1790100428.923767:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126252032 00000100:00100000:1.0:1790100428.923816:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126252160 00000100:00100000:1.0:1790100428.923819:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126252160 00000100:00100000:1.0:1790100428.923849:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790100428.923858:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126252032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790100428.923884:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1790100428.923930:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ab2c3cb, atime: 0x6ab2c3cb, ctime: 0x6ab2c3cb, blocks: 0xb 00010000:00010000:1.0:1790100428.923938:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.923956:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:1.0:1790100428.923960:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100428.923967:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.923984:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.923995:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.924003:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.924021:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790100428.924654:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1877056126252032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 795us (1217us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790100428.924663:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790100428.924684:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790100428.924692:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1877056126252160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790100428.924707:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1790100428.924726:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.924754:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d21 expref: 11 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.924762:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790100428.924765:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100428.924769:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.924799:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d21 expref: 11 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.924814:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d21 expref: 11 pid: 12004 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.924826:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877056126252288:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100428.924894:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f82000 going to sleep for 11 seconds 00000100:00080000:1.0:1790100428.924919:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790100428.924933:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100428.924940:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.924948:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100428.924953:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.924974:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.924994:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.925002:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefd791 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.925021:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100428.925024:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100428.925025:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100428.928118:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1790100428.928134:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1790100428.928159:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67ad537b80, transno 4294967301 00000004:00080000:0.0:1790100428.928178:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1790100428.928197:0:3314:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d67ad537480 x1877056126252032/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790100444 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790100428.928210:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67ad537480/2, rc 0, transno 4294967304 00000100:00100000:0.0:1790100428.928217:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126252032:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790100428.928675:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:10572:x1877056109468544:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 50061us (50373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.928686:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:3.0:1790100428.928850:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.928876:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109468672 00000100:00100000:3.0:1790100428.928885:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109468672 00010000:00010000:3.0:1790100428.928927:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d21 expref: 12 pid: 12004 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.928961:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:3.0:1790100428.928971:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:2358:x1877056109468672:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100428.928985:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100428.928992:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d21 expref: 12 pid: 12004 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.929005:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d21 expref: 12 pid: 12004 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.929031:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100428.929035:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100428.929041:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.929072:0:12013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.929094:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100428.929118:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:2358:x1877056109468672:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 148us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.929124:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00010000:00010000:1.0:1790100428.930171:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da8c8714/0x31a8f3fdeeefd553 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d21 expref: 11 pid: 12004 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.930192:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877056126252288:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100428.930210:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.930221:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.930229:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.930254:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.930262:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.930282:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100428.930986:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100428.930994:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.931006:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100428.931011:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.931021:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.931039:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.931046:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6822774/0x31a8f3fdeeefd798 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.931066:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100428.931075:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100428.931077:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100428.932758:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1877056126252160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8046us (9056us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790100428.932773:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1790100428.933020:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67bf975180/2, rc 0, transno 4294967309 00000100:00100000:0.0:1790100428.933042:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126252160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790100428.935521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.935603:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109468800 00000100:00100000:1.0:1790100428.935652:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109468800 00000100:00100000:1.0:1790100428.935718:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:1.0:1790100428.935729:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:2357:x1877056109468800:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790100428.963539:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:2357:x1877056109468800:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 27800us (28016us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.963554:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000001:00080000:0.0:1790100428.963765:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1790100428.963787:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1790100428.969975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100428.970068:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109469056 00000100:00100000:2.0:1790100428.970080:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109469056 00000100:00100000:2.0:1790100428.970143:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:2.0:1790100428.970154:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:10572:x1877056109469056:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100428.970215:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100428.970247:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd77c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64db4 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.970270:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:2.0:1790100428.970276:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100428.970313:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.970347:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.970358:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100428.970683:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027d5cb3d reply state 0000000095b78c15 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.970713:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100428.970814:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:10572:x1877056109469056:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 660us (849us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1790100428.970822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 125 00010000:00010000:0.0:1790100428.973798:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.973817:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.973842:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.973848:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100428.973853:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.973862:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.973879:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:0.0:1790100428.973882:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100428.973887:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.973895:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefd79f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.975676:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100428.975771:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109469184 00000100:00100000:2.0:1790100428.975782:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109469184 00000100:00100000:2.0:1790100428.975832:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:2.0:1790100428.975842:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2359:x1877056109469184:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790100428.976097:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790100428.976102:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790100427 00002000:00010000:2.0:1790100428.976104:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790100427 00002000:00010000:2.0:1790100428.976107:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790100428 -> 1790100427 00002000:00010000:2.0:1790100428.976109:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790100428.976175:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2359:x1877056109469184:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 334us (508us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790100428.976184:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:2.0:1790100428.979141:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100428.979217:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109469440 00000100:00100000:0.0:1790100428.979229:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109469440 00000100:00100000:0.0:1790100428.979297:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:0.0:1790100428.979308:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:10572:x1877056109469440:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790100428.979405:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.979424:0:11548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64da6 expref: 15 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.979454:0:11548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.979503:0:11548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64da6 expref: 15 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100428.979516:0:11548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64da6 expref: 15 pid: 11548 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.979531:0:11548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785128000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126252416:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100428.979769:0:11548:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100428.983632:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.983702:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109469568 00000100:00100000:1.0:1790100428.983714:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109469568 00010000:00010000:1.0:1790100428.983773:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64da6 expref: 16 pid: 11548 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.983819:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:1.0:1790100428.983830:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:2358:x1877056109469568:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100428.983848:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100428.983856:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64da6 expref: 16 pid: 11548 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.983899:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64da6 expref: 16 pid: 11548 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.983926:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:1.0:1790100428.983932:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.983944:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.983953:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.983976:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100428.984045:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:2358:x1877056109469568:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 216us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100428.984053:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00010000:00010000:2.0:1790100428.985718:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64da6 expref: 15 pid: 11548 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.985848:0:11548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785128000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126252416:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100428.985872:0:11548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.985884:0:11548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.985906:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.985940:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.985948:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.985955:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.985962:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100428.985966:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.985974:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.985989:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:2.0:1790100428.985993:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790100428.985997:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.986002:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.986126:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:10572:x1877056109469440:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 6820us (6994us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790100428.986136:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:2.0:1790100428.989295:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100428.989409:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109469696 00000100:00100000:1.0:1790100428.989419:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109469696 00000100:00100000:1.0:1790100428.989592:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:1.0:1790100428.989604:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2360:x1877056109469696:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790100428.989762:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.989784:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.989813:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100428.989817:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100428.989822:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.989859:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100428.989873:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 7 pid: 6687 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100428.989888:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1877056126252544:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100428.989980:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788df4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790100428.992448:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1877056126252544:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100428.992486:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100428.994347:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100428.994978:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109469824 00000100:00100000:3.0:1790100428.994990:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109469824 00010000:00010000:3.0:1790100428.995038:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 8 pid: 6687 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100428.995088:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:3.0:1790100428.995098:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109469824:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100428.995115:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100428.995139:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 8 pid: 6687 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.995153:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 8 pid: 6687 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.995179:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d4ec0b/0x31a8f3fdeeefd78a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc2 expref: 8 pid: 6687 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.995197:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100428.995202:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100428.995209:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.995240:0:12013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100428.995351:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100428.995416:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109469824:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 318us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100428.995424:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00010000:00010000:2.0:1790100428.996947:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.996963:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.997000:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.997010:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.997018:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.997025:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100428.997030:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.997040:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.997084:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100428.997093:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6a8a24c/0x31a8f3fdeeefd7ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100428.997267:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109469696:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 7661us (7976us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100428.997277:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:2.0:1790100429.000106:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100429.000167:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109470080 00000100:00100000:3.0:1790100429.000178:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109470080 00000100:00100000:3.0:1790100429.000246:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 127 00000100:00100000:3.0:1790100429.000256:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:10572:x1877056109470080:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790100429.000354:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.000375:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.000387:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.000661:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.000673:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dad expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.000681:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.000725:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dad expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.000740:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dad expref: 15 pid: 6711 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.000756:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126252672:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100429.001284:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787d709c0 going to sleep for 10 seconds 00000100:00100000:2.0:1790100429.005048:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100429.005136:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126252672:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100429.005168:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100429.005240:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109470208 00000100:00100000:0.0:1790100429.005248:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109470208 00010000:00010000:0.0:1790100429.005308:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dad expref: 16 pid: 6711 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100429.005356:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:0.0:1790100429.005366:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:2358:x1877056109470208:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100429.005384:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100429.005391:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dad expref: 16 pid: 6711 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.005403:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dad expref: 16 pid: 6711 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.005447:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd76e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dad expref: 16 pid: 6711 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.005478:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:0.0:1790100429.005484:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.005494:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.005503:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.005528:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100429.005573:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:2358:x1877056109470208:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 208us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100429.005580:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00010000:00010000:0.0:1790100429.005604:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.005636:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100429.005821:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1790100429.005973:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1790100429.006017:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1790100429.006111:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf399880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1877056126252800:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790100429.006159:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100429.006187:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100429.006213:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126252800 00000100:00100000:0.0:1790100429.006218:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126252800 00000100:00100000:0.0:1790100429.006247:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100429.006254:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1877056126252800:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790100429.006319:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1877056126252800:12345-0@lo:1000:mdt00_000.0 Request processed in 65us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100429.006326:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100429.006373:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1790100429.006379:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1790100429.006394:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67bf975180, transno 4294967309 00000100:00100000:0.0:1790100429.006406:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf399880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1877056126252800:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790100429.006812:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1790100429.006858:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf399880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1877056126252928:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790100429.006884:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100429.006900:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100429.007775:0:12069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126252928 00000100:00100000:2.0:1790100429.007783:0:12069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126252928 00000100:00100000:2.0:1790100429.007825:0:12069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790100429.007833:0:12069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5841:x1877056126252928:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790100429.008053:0:12069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5841:x1877056126252928:12345-0@lo:1000:mdt00_000.0 Request processed in 221us (1167us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790100429.008062:0:12069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1790100429.008084:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100429.010952:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf399880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1877056126252928:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1790100429.011006:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011018:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011026:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011032:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100429.011037:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011046:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011081:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787edf700) 00010000:00010000:3.0:1790100429.011084:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100429.011090:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011097:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd7bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011132:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011139:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011145:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011150:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100429.011152:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011158:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011168:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:3.0:1790100429.011171:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100429.011177:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd705 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d91 expref: 18 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011188:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd705 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d91 expref: 18 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011204:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd705 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d91 expref: 18 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.011243:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd705 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d91 expref: 18 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100429.011258:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126253056:192.168.201.18@tcp:105: 00000100:00100000:3.0:1790100429.011370:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787d709c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100429.014587:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126253056:192.168.201.18@tcp:105: 00010000:00010000:0.0:1790100429.014647:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014659:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd6fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014697:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014714:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014726:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014755:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014762:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014768:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014775:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100429.014779:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014787:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014800:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100429.014803:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100429.014807:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014813:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014826:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014832:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014838:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014849:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100429.014852:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014858:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014866:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100429.014868:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790100429.014871:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.014877:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd7b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100429.015126:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:10572:x1877056109470080:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 14869us (15029us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1790100429.015137:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 127 00000020:00080000:0.0:1790100429.015143:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790100429.016456:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100429.016475:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100429.017000:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1790100429.017015:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790100429.018754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100429.019046:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109470336 00000100:00100000:3.0:1790100429.019058:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109470336 00000100:00100000:3.0:1790100429.019122:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:3.0:1790100429.019133:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:10571:x1877056109470336:12345-192.168.201.18@tcp:49:lfs.0 00000100:00100000:3.0:1790100429.019267:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:10571:x1877056109470336:12345-192.168.201.18@tcp:49:lfs.0 Request processed in 136us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.019274:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:1.0:1790100429.021498:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100429.021756:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109470592 00000100:00100000:3.0:1790100429.021766:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109470592 00000100:00100000:3.0:1790100429.021819:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:3.0:1790100429.021830:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d679e03a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:10572:x1877056109470592:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790100429.022541:0:5845:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790100429.022695:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1790100429.022756:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.022775:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.022788:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.022798:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.022804:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.022810:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100429.022827:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790100429.022935:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d679e03a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:10572:x1877056109470592:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 1105us (1453us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1790100429.022945:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000020:00080000:3.0:1790100429.022951:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790100429.023988:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100429.024001:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.024010:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100429.024015:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.024025:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.024042:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d6787ec1900) 00010000:00010000:1.0:1790100429.024056:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790100429.024061:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.024067:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd7c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100429.024085:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100429.024087:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100429.024089:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100429.030149:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100429.030308:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109470848 00000100:00100000:3.0:1790100429.030322:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109470848 00000100:00100000:3.0:1790100429.030407:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 128 00000100:00100000:3.0:1790100429.030419:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:10571:x1877056109470848:12345-192.168.201.18@tcp:58:lfs.0 00000040:00080000:3.0:1790100429.030941:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1790100429.031141:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:10571:x1877056109470848:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 723us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.031150:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 128 00000100:00100000:2.0:1790100429.052966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100429.053083:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109470976 00000100:00100000:0.0:1790100429.053094:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109470976 00000100:00100000:0.0:1790100429.053152:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 129 00000100:00100000:0.0:1790100429.053161:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:10574:x1877056109470976:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100429.053183:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100429.053203:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64dc9 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053271:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053298:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053308:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053320:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053325:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053329:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053689:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053698:0:11548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d8a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053704:0:11548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053733:0:11548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d8a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.053743:0:11548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d8a expref: 21 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100429.053762:0:11548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf39a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126253184:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100429.053860:0:11548:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100429.061111:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100429.061179:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109471232 00000100:00100000:3.0:1790100429.061188:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109471232 00000100:00100000:3.0:1790100429.061254:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:3.0:1790100429.061265:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:5593:x1877056109471232:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790100429.061590:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:5593:x1877056109471232:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 326us (487us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1790100429.061598:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:0.0:1790100429.061729:0:11548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf39a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126253184:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100429.061757:0:11548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100429.063941:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100429.064056:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109471360 00000100:00100000:0.0:1790100429.064067:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109471360 00010000:00010000:0.0:1790100429.064109:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d8a expref: 23 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100429.064191:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:0.0:1790100429.064213:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:2357:x1877056109471360:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100429.064229:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100429.064237:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d8a expref: 23 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.064252:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d8a expref: 23 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.064274:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd6f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d8a expref: 23 pid: 5841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.064291:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100429.064297:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.064322:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.064331:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100429.064379:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100429.064439:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:2357:x1877056109471360:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 238us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100429.064454:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00010000:00010000:2.0:1790100429.064998:0:11548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065008:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100429.065066:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790100429.065071:0:11548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100429.065091:0:11548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065105:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065114:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065121:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065127:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065133:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100429.065137:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065144:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065154:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:2.0:1790100429.065157:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100429.065161:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065167:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefd7d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065192:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065211:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065217:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065222:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100429.065225:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065232:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065240:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d6787edfe00) 00010000:00010000:2.0:1790100429.065243:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100429.065246:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065252:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefd7de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065288:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefd7d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc9 expref: 22 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065302:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc9 expref: 21 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100429.065321:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:2.0:1790100429.065324:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100429.065326:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818000, rc 0) 00000100:00100000:2.0:1790100429.065382:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:10574:x1877056109470976:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 12221us (12424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100429.065389:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 129 00010000:00010000:3.0:1790100429.093876:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100429.363513:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100429.364070:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109471616 00000100:00100000:0.0:1790100429.364081:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109471616 00000100:00100000:0.0:1790100429.364145:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:0.0:1790100429.364156:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:2359:x1877056109471616:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100429.373942:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:2359:x1877056109471616:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 9774us (10426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100429.373959:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 115 00000100:00100000:1.0:1790100429.375285:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100429.375573:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100429.375625:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100429.375660:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100429.375801:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109471488 00000100:00100000:1.0:1790100429.375821:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109471488 00000100:00100000:1.0:1790100429.375889:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 279 00000100:00100000:1.0:1790100429.375900:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2359:x1877056109471488:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100429.375988:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2359:x1877056109471488:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 90us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.375996:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 279 00000100:00100000:1.0:1790100429.376033:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109471872 00000100:00100000:1.0:1790100429.376037:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109471872 00000100:00100000:1.0:1790100429.376077:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109471744 00000100:00100000:1.0:1790100429.376080:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109471744 00000100:00100000:1.0:1790100429.376101:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:1.0:1790100429.376108:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2359:x1877056109471872:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100429.376141:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2359:x1877056109471872:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 34us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.376168:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:1.0:1790100429.376181:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:1.0:1790100429.376188:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109471744:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100429.376216:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109471744:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100429.376222:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00080000:1.0:1790100429.376387:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100429.376425:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109472000 00000100:00100000:1.0:1790100429.376429:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109472000 00000100:00080000:1.0:1790100429.376475:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100429.376486:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 116 00000100:00100000:3.0:1790100429.376496:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109472000:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100429.376539:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109472000:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 45us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100429.376545:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 116 00000040:00080000:1.0:1790100429.916776:0:12109:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100429.916790:0:12109:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790100429.916845:0:12109:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1790100429.916856:0:12109:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:3.0:1790100430.055204:0:8114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326624589655ns, next at 327624586520ns, rc = 0 00000100:00100000:3.0:1790100430.055232:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100430.055256:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126253312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100430.055343:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100430.055426:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126253312 00000100:00100000:3.0:1790100430.055435:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126253312 00000100:00100000:3.0:1790100430.055496:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790100430.055505:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877056126253312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100430.055527:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1790100430.055571:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877056126253312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.055579:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1790100430.055599:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100430.055670:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126253312:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1790100430.056237:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100430.056243:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100430.056293:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790100430.056302:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100430.056447:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf39a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126253440:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790100430.056524:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787a21600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100430.057661:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126253696:0@lo:400:kworker.0 00000100:00100000:3.0:1790100430.057831:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100430.057878:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790100430.057885:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126253568:0@lo:400:kworker.0 00000100:00100000:1.0:1790100430.058770:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126253952:0@lo:400:kworker.0 00000100:00100000:0.0:1790100430.061331:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100430.061400:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100430.061412:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126253824:0@lo:400:kworker.0 00000100:00100000:0.0:1790100430.061448:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100430.061546:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126253952 00000100:00100000:1.0:1790100430.061557:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126253952 00000100:00100000:1.0:1790100430.061761:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790100430.061772:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126253952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100430.061838:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126253952:12345-0@lo:400:kworker.0 Request processed in 69us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100430.061848:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790100430.061900:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126253952:0@lo:400:kworker.0 00000100:00080000:0.0:1790100430.062016:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100430.062163:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100430.062313:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126254080:0@lo:400:kworker.0 00000100:00100000:3.0:1790100430.062358:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100430.062432:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126253696 00000100:00100000:3.0:1790100430.062437:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126253696 00000100:00100000:3.0:1790100430.062474:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126253824 00000100:00100000:3.0:1790100430.062478:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126253824 00000100:00100000:3.0:1790100430.062498:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126254080 00000100:00100000:3.0:1790100430.062501:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126254080 00000100:00100000:3.0:1790100430.062517:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790100430.062525:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126253696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100430.062580:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126253696:12345-0@lo:400:kworker.0 Request processed in 44us (4738us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.062587:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790100430.062747:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790100430.062757:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126253824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100430.062797:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126253824:12345-0@lo:400:kworker.0 Request processed in 43us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.062804:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1790100430.062820:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790100430.062826:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126254080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100430.062865:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126254080:12345-0@lo:400:kworker.0 Request processed in 39us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.062872:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1790100430.062906:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100430.063092:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126253824:0@lo:400:kworker.0 00000100:00100000:3.0:1790100430.063130:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126254080:0@lo:400:kworker.0 00000100:00100000:3.0:1790100430.063146:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126253696:0@lo:400:kworker.0 00000100:00100000:1.0:1790100430.063388:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126253568 00000100:00100000:1.0:1790100430.063394:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126253568 00000100:00100000:1.0:1790100430.063468:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1790100430.063482:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126253568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100430.063537:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126253568:12345-0@lo:400:kworker.0 Request processed in 56us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100430.063544:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1790100430.063638:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb96bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126253568:0@lo:400:kworker.0 00000100:00100000:1.0:1790100430.064104:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100430.064239:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109472128 00000100:00100000:3.0:1790100430.064244:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109472128 00000100:00100000:3.0:1790100430.064289:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 130 00000100:00100000:3.0:1790100430.064299:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:10586:x1877056109472128:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790100430.064337:0:11548:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790100430.064433:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:10586:x1877056109472128:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 135us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100430.064441:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 130 00000100:00100000:0.0:1790100430.065357:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf39a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126253440:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790100430.071335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100430.071599:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109472384 00000100:00100000:0.0:1790100430.071633:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109472384 00000100:00100000:0.0:1790100430.071692:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:0.0:1790100430.071703:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:10586:x1877056109472384:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100430.071725:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100430.071746:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd7ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64dd0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.071851:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd7f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.071867:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.071881:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100430.071894:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790100430.072039:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefd7ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dd0 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.072059:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dd0 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100430.072068:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100430.072079:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100430.072083:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819a00, rc 0) 00000100:00100000:0.0:1790100430.072138:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:10586:x1877056109472384:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 437us (826us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1790100430.072145:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:1.0:1790100430.087164:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100430.087262:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100430.087300:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109472640 00000100:00100000:2.0:1790100430.087304:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109472768 00000100:00100000:1.0:1790100430.087312:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109472640 00000100:00100000:2.0:1790100430.087313:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109472768 00000100:00100000:2.0:1790100430.087513:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1790100430.087525:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:2358:x1877056109472768:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100430.087544:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100430.087569:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefd7f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dd0 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100430.087589:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:2.0:1790100430.087594:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100430.087679:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:2358:x1877056109472768:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 155us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100430.087688:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:1.0:1790100430.091982:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 132 00000100:00100000:1.0:1790100430.091998:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:10586:x1877056109472640:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790100430.092090:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.092110:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.092123:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.092336:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.092345:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.092352:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.092375:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100430.092379:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.092387:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.092401:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:1.0:1790100430.092404:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790100430.092409:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100430.092415:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd801 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100430.092702:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:10586:x1877056109472640:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 706us (5545us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1790100430.092711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 132 00000040:00080000:2.0:1790100430.092761:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100430.092767:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100430.093263:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790100430.093279:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790100430.096977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100430.097035:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109473024 00000100:00100000:3.0:1790100430.097046:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109473024 00000100:00100000:3.0:1790100430.097124:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:3.0:1790100430.097135:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:10586:x1877056109473024:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790100430.097404:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:10586:x1877056109473024:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 270us (435us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1790100430.097411:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00010000:00010000:1.0:1790100430.118725:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100431.078230:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100431.078255:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf39a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126254208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100431.078359:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100431.078556:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126254208 00000100:00100000:0.0:1790100431.078565:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126254208 00000100:00100000:0.0:1790100431.078648:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790100431.078659:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126254208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100431.078697:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100431.078747:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126254208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100431.078753:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790100431.078965:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf39a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126254208:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790100431.143691:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100431.929949:0:12160:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100431.929959:0:12160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100431.932939:0:12160:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790100431.932954:0:12160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790100432.181921:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100432.268803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100432.269146:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109473280 00000100:00100000:3.0:1790100432.269157:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109473280 00000100:00100000:3.0:1790100432.269240:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 133 00000100:00100000:3.0:1790100432.269254:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:10607:x1877056109473280:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100432.269292:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100432.269314:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd808 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64dd7 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.269451:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd80f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.269467:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd80f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.269479:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd80f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100432.269491:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790100432.269660:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aec00/0x31a8f3fdeeefd808 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dd7 expref: 27 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.269680:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd80f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dd7 expref: 26 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.269688:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:3.0:1790100432.269691:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790100432.269694:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900afe00, rc 0) 00000100:00100000:3.0:1790100432.269768:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:10607:x1877056109473280:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 517us (986us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1790100432.269800:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 133 00000100:00080000:0.0:1790100432.270711:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100432.279038:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100432.279142:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109473408 00000100:00100000:0.0:1790100432.279167:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109473408 00000100:00100000:0.0:1790100432.279227:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 134 00000100:00100000:0.0:1790100432.279237:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:10607:x1877056109473408:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:0.0:1790100432.279315:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100432.279331:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100432.279344:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100432.279370:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100432.279393:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100432.279400:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100432.279406:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100432.279410:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100432.279427:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100432.279444:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:0.0:1790100432.279447:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790100432.279452:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100432.279457:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefd81d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100432.279707:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:10607:x1877056109473408:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 470us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100432.279716:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 134 00000100:00100000:2.0:1790100432.408540:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100432.408678:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109473536 00000100:00100000:3.0:1790100432.408689:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109473536 00000100:00100000:3.0:1790100432.408771:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:3.0:1790100432.408784:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2359:x1877056109473536:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1790100432.408803:0:12004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100432.408823:0:12004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefd824 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64dde expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100432.408849:0:12004:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ab2c3cb, atime: 0x6ab2c3cb, ctime: 0x6ab2c3cb, blocks: 0xb 00010000:00010000:3.0:1790100432.408868:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1790100432.408873:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100432.408882:0:12004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefd824 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dde expref: 7 pid: 12004 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.408901:0:12004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefd824 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dde expref: 7 pid: 12004 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100432.408914:0:12004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900aec00, rc 0) 00000100:00100000:3.0:1790100432.408982:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2359:x1877056109473536:12345-192.168.201.18@tcp:101:cat.0 Request processed in 201us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100432.408988:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00080000:0.0:1790100432.409674:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100432.418251:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100432.418379:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109473664 00000100:00100000:2.0:1790100432.418390:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109473664 00002000:00100000:2.0:1790100432.418450:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8d67bb96aa00 x1877056109473664/t0(0) o3->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:728/0 lens 488/0 e 0 to 0 dl 1790100443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100432.418461:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bb96aa00 with x1877056109473664 ext(0->4095) 00002000:00010000:2.0:1790100432.418466:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bb96aa00 00000100:00100000:2.0:1790100432.418501:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:2.0:1790100432.418520:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2360:x1877056109473664:12345-192.168.201.18@tcp:3:cat.0 00000100:00100000:2.0:1790100432.418769:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2360:x1877056109473664:12345-192.168.201.18@tcp:3:cat.0 Request processed in 258us (526us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790100432.418790:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00002000:00100000:2.0:1790100432.418798:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8d67bb96aa00 x1877056109473664/t0(0) o3->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:728/0 lens 488/4536 e 0 to 0 dl 1790100443 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100432.418805:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bb96aa00 with x1877056109473664 ext(0->4095) 00002000:00010000:2.0:1790100432.418808:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bb96aa00 00010000:00010000:1.0:1790100433.189801:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790100433.681635:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1790100434.214722:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790100434.230515:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1790100434.230532:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1790100434.240885:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:0.0:1790100434.240913:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d67a9735540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1790100434.240918:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6787d08900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d67a9735a80 00000020:00080000:0.0:1790100434.240927:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d6787d08b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d67bf979400 00000020:00080000:0.0:1790100434.240941:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1790100434.240954:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1790100434.241134:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1790100434.241152:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:0.0:1790100434.241178:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000004:00080000:0.0:1790100434.241190:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1790100434.252575:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100434.252602:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126254336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790100434.252697:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100434.252744:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126254336 00000100:00100000:1.0:1790100434.252753:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126254336 00000100:00100000:1.0:1790100434.252827:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790100434.252839:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126254336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790100434.253135:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790100434.253140:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1790100427 -> 1790100427 00002000:00010000:1.0:1790100434.253142:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1790100427 -> 1790100427 00002000:00010000:1.0:1790100434.253145:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790100427 -> 1790100427 00002000:00010000:1.0:1790100434.253147:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790100434.253203:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126254336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 367us (506us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790100434.253212:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790100434.253302:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1790100434.253309:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1790100434.253331:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d67bf39aa00 x1877056126254336/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790100450 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790100434.253343:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1790100434.253343:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67bf39aa00/2, rc 0, transno 4294967312 00000100:00100000:0.0:1790100434.253348:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126254336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790100434.518381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100434.518429:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100434.518452:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100434.518469:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100434.518491:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100434.518576:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109473920 00000100:00100000:2.0:1790100434.518587:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109473920 00000100:00100000:2.0:1790100434.518679:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109474304 00000100:00100000:2.0:1790100434.518683:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109474304 00000100:00100000:2.0:1790100434.518709:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:2.0:1790100434.518720:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2358:x1877056109473920:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100434.518799:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2358:x1877056109473920:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 80us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.518820:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 120 00000100:00100000:2.0:1790100434.518843:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:2.0:1790100434.518850:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109474304:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100434.518893:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109474304:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 34us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.518899:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 121 00000100:00100000:2.0:1790100434.518938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109473792 00000100:00100000:2.0:1790100434.518943:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109473792 00000100:00100000:2.0:1790100434.518973:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 281 00000100:00100000:2.0:1790100434.518980:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109473792:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100434.519008:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109473792:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.519014:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 281 00000100:00100000:2.0:1790100434.519044:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109474176 00000100:00100000:2.0:1790100434.519048:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109474176 00000100:00100000:2.0:1790100434.519082:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109474048 00000100:00100000:2.0:1790100434.519085:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109474048 00000100:00100000:2.0:1790100434.519111:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:2.0:1790100434.519118:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109474176:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100434.519148:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb969180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109474176:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 30us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.519154:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:2.0:1790100434.519166:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:2.0:1790100434.519174:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb96b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109474048:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100434.519211:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb96b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109474048:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 39us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100434.519218:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00080000:1.0:1790100434.519707:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100434.519712:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790100434.519715:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100435.175714:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b58e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126254464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100435.175787:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100435.175867:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126254464 00000100:00100000:2.0:1790100435.175875:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126254464 00000100:00100000:2.0:1790100435.175922:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790100435.175931:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126254464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100435.175966:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100435.176010:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126254464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100435.176018:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790100435.176066:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b58e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126254464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100435.176247:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126254720:0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.176281:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100435.176310:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790100435.176316:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126254592:0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.176347:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100435.176398:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126255104:0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.176421:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100435.176447:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126254592 00000100:00100000:1.0:1790100435.176451:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126254592 00000100:00100000:1.0:1790100435.176473:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1790100435.176480:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126254592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.176515:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3314:x1877056126254592:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100435.176521:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1790100435.176554:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126254592:0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.176584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126254720 00000100:00100000:1.0:1790100435.176588:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126254720 00000100:00100000:1.0:1790100435.176634:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126255104 00000100:00100000:1.0:1790100435.176638:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126255104 00000100:00100000:1.0:1790100435.176665:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790100435.176671:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126254720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.176707:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126254720:12345-0@lo:400:kworker.0 Request processed in 36us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100435.176713:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790100435.176725:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1790100435.176731:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126255104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.176757:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1877056126255104:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100435.176763:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1790100435.176781:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100435.176800:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1877056126255104:0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.176822:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126254720:0@lo:400:kworker.0 00000100:00100000:2.0:1790100435.177447:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126254848:0@lo:400:kworker.0 00000100:00100000:2.0:1790100435.177486:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100435.177527:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100435.177534:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126254976:0@lo:400:kworker.0 00000100:00100000:2.0:1790100435.177559:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100435.177591:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126254976 00000100:00100000:2.0:1790100435.177596:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126254976 00000100:00100000:2.0:1790100435.177662:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790100435.177669:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126254976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100435.177714:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126254976:12345-0@lo:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100435.177733:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1790100435.177753:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100435.177774:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1790100435.177780:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67ad537480, transno 4294967304 00000100:00100000:2.0:1790100435.177793:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126254976:0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.178194:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126254848 00000100:00100000:1.0:1790100435.178199:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126254848 00000100:00100000:1.0:1790100435.178286:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1790100435.178294:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126254848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100435.178339:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126254848:12345-0@lo:400:kworker.0 Request processed in 47us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100435.178345:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1790100435.178481:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100435.178506:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126254848:0@lo:400:kworker.0 00010000:00010000:1.0:1790100435.238769:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100436.211654:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100436.211679:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b58e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126255232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100436.211761:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100436.211845:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126255232 00000100:00100000:2.0:1790100436.211854:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126255232 00000100:00100000:2.0:1790100436.211900:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790100436.211909:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126255232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100436.211948:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100436.211993:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126255232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100436.211999:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790100436.212240:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b58e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126255232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100436.264939:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100437.286382:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100438.310898:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100438.311094:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100438.311100:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100438.311385:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1790100438.311391:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790100439.337323:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790100439.344148:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1790100439.346398:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1790100439.346417:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1790100439.414990:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:1.0:1790100439.603809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100439.603854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100439.603893:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100439.603932:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100439.603977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100439.604005:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109474816 00000100:00100000:1.0:1790100439.604028:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109474816 00000100:00100000:1.0:1790100439.604084:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109474688 00000100:00100000:1.0:1790100439.604088:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109474688 00000100:00100000:1.0:1790100439.604114:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:1.0:1790100439.604125:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109474816:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100439.604217:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109474816:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 93us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100439.604226:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:1.0:1790100439.604247:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:1.0:1790100439.604255:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109474688:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100439.604314:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109474688:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 60us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100439.604321:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:0.0:1790100439.605714:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109474432 00000100:00100000:0.0:1790100439.605725:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109474432 00000100:00100000:0.0:1790100439.605777:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 283 00000100:00100000:0.0:1790100439.605787:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109474432:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100439.605857:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109474432:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 72us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100439.605868:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 283 00000100:00100000:2.0:1790100439.606507:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109474560 00000100:00100000:2.0:1790100439.606514:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109474560 00000100:00100000:2.0:1790100439.606552:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109474944 00000100:00100000:2.0:1790100439.606555:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109474944 00000100:00100000:2.0:1790100439.606589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:2.0:1790100439.606597:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2357:x1877056109474560:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100439.606928:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00100000:3.0:1790100439.606939:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109474944:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100439.606991:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109474944:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 54us (3014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100439.607000:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 126 00000100:00080000:3.0:1790100439.607096:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790100439.607100:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790100439.607103:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100439.607178:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2357:x1877056109474560:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 581us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100439.607194:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 125 00000100:00100000:1.0:1790100439.650582:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100439.652265:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109475072 00000100:00100000:2.0:1790100439.652282:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109475072 00000100:00100000:2.0:1790100439.652434:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 135 00000100:00100000:2.0:1790100439.652446:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:10252:x1877056109475072:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790100439.652571:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:10252:x1877056109475072:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 Request processed in 127us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100439.652579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 135 00000100:00100000:1.0:1790100439.659808:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100439.662740:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109475328 00000100:00100000:3.0:1790100439.662764:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109475328 00000100:00100000:3.0:1790100439.662859:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:3.0:1790100439.662870:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:10252:x1877056109475328:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790100439.663792:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:10252:x1877056109475328:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 918us (4002us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1790100439.663896:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:1.0:1790100440.294644:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126255744:0@lo:400:kworker.0 00000100:00100000:1.0:1790100440.294714:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100440.295179:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790100440.295188:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b16b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126255616:0@lo:400:kworker.0 00000100:00100000:1.0:1790100440.295217:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100440.295235:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126256128:0@lo:400:kworker.0 00000100:00100000:1.0:1790100440.295258:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100440.295293:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126256128 00000100:00100000:1.0:1790100440.295301:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126256128 00000100:00100000:1.0:1790100440.295353:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790100440.295363:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126256128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100440.295489:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126255744 00000100:00100000:3.0:1790100440.295494:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126255744 00000100:00100000:3.0:1790100440.295535:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126255616 00000100:00100000:3.0:1790100440.295538:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126255616 00000100:00100000:3.0:1790100440.295558:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790100440.295564:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126255744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100440.295631:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126255744:12345-0@lo:400:kworker.0 Request processed in 67us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100440.295650:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1790100440.295671:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790100440.295676:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126255616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100440.295705:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126255616:12345-0@lo:400:kworker.0 Request processed in 29us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100440.295710:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1790100440.295728:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790100440.295733:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100440.295764:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b16b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126255616:0@lo:400:kworker.0 00000100:00100000:3.0:1790100440.295776:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126255744:0@lo:400:kworker.0 00000100:00100000:1.0:1790100440.295958:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126256128:12345-0@lo:400:kworker.0 Request processed in 596us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100440.295966:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790100440.296061:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126255360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100440.296093:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100440.296128:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b16bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126255872:0@lo:400:kworker.0 00000100:00100000:2.0:1790100440.296161:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100440.296180:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790100440.296187:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b169c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126255488:0@lo:400:kworker.0 00000100:00100000:2.0:1790100440.296212:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100440.296234:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b16b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126256000:0@lo:400:kworker.0 00000100:00100000:2.0:1790100440.296253:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100440.296279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126255488 00000100:00100000:2.0:1790100440.296283:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126255488 00000100:00100000:2.0:1790100440.296307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1790100440.296314:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126255488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100440.296346:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126255488:12345-0@lo:400:kworker.0 Request processed in 33us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100440.296360:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1790100440.296724:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b169c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126255488:0@lo:400:kworker.0 00000100:00100000:2.0:1790100440.296744:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126256000 00000100:00100000:2.0:1790100440.296748:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126256000 00000100:00100000:2.0:1790100440.296780:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1790100440.296786:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126256000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100440.296822:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126256000:12345-0@lo:400:kworker.0 Request processed in 36us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100440.296828:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1790100440.296841:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100440.296859:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b16b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126256000:0@lo:400:kworker.0 00000100:00100000:1.0:1790100440.296998:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126255360 00000100:00100000:1.0:1790100440.297003:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126255360 00000100:00100000:1.0:1790100440.297089:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790100440.297097:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126255360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100440.297126:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100440.297650:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126255360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 553us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100440.297667:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790100440.300016:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126255872 00000100:00100000:3.0:1790100440.300044:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126255872 00000100:00100000:3.0:1790100440.300150:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790100440.300162:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126255872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100440.300250:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126255872:12345-0@lo:400:kworker.0 Request processed in 91us (4088us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100440.300257:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790100440.300307:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1790100440.300313:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67bf39aa00, transno 4294967312 00000100:00100000:3.0:1790100440.300334:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126256128:0@lo:400:kworker.0 00000100:00080000:2.0:1790100440.303157:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100440.308113:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126255360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100440.308139:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b16bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126255872:0@lo:400:kworker.0 00010000:00010000:0.0:1790100440.359639:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100441.317912:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b58e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126256256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100441.317991:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100441.318197:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126256256 00000100:00100000:2.0:1790100441.318206:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126256256 00000100:00100000:2.0:1790100441.318253:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790100441.318261:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126256256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100441.318293:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100441.319493:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126256256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1228us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100441.319505:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790100441.358526:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b58e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126256256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790100441.381951:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100442.416951:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790100442.771937:0:12363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:07:20 (1790100440) 00010000:00010000:1.0:1790100443.430069:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100444.454468:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790100444.483929:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000100:00100000:2.0:1790100444.722952:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100444.723048:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100444.723096:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100444.723152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100444.723212:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109475712 00000100:00100000:0.0:1790100444.723226:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109475712 00000100:00100000:0.0:1790100444.723317:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:0.0:1790100444.723330:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109475712:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100444.723436:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109475712:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 109us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100444.723445:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00080000:0.0:1790100444.723470:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100444.723677:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109475456 00000100:00100000:1.0:1790100444.723682:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109475456 00000100:00100000:1.0:1790100444.723748:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 285 00000100:00100000:1.0:1790100444.723757:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2359:x1877056109475456:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100444.723800:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2359:x1877056109475456:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 44us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100444.723825:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 285 00000100:00100000:2.0:1790100444.727428:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100444.727815:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109475840 00000100:00100000:1.0:1790100444.727833:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109475840 00000100:00100000:1.0:1790100444.727914:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:1.0:1790100444.727927:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109475840:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100444.728018:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109475840:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 94us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100444.728027:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00080000:2.0:1790100444.729057:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100444.729377:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109475584 00000100:00100000:3.0:1790100444.729387:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109475584 00000100:00100000:3.0:1790100444.729502:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109475968 00000100:00100000:3.0:1790100444.729507:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109475968 00000100:00100000:0.0:1790100444.729569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 130 00000100:00100000:0.0:1790100444.729582:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2360:x1877056109475584:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100444.729676:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2360:x1877056109475584:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 97us (6739us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100444.729683:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 130 00000100:00080000:2.0:1790100444.731684:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100444.732312:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:3.0:1790100444.732327:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109475968:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100444.732465:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109475968:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 142us (9311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100444.732473:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 131 00000100:00100000:0.0:1790100445.414043:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6783504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126256384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100445.414173:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100445.414644:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126256384 00000100:00100000:1.0:1790100445.414659:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126256384 00000100:00100000:1.0:1790100445.414745:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790100445.414754:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126256384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100445.414799:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100445.414874:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126256384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100445.414880:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790100445.415218:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b58e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126256640:0@lo:400:kworker.0 00000100:00100000:2.0:1790100445.415254:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100445.415281:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100445.415286:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126256768:0@lo:400:kworker.0 00000100:00100000:2.0:1790100445.415317:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100445.415339:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126256640 00000100:00100000:2.0:1790100445.415506:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126256640 00000100:00100000:2.0:1790100445.415536:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126256768 00000100:00100000:2.0:1790100445.415539:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126256768 00000100:00100000:2.0:1790100445.415553:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790100445.415559:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126256640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100445.415606:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126256640:12345-0@lo:400:kworker.0 Request processed in 35us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100445.415635:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790100445.415646:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790100445.415651:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126256768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100445.415675:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126256768:12345-0@lo:400:kworker.0 Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100445.415681:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1790100445.415716:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126256768:0@lo:400:kworker.0 00000100:00100000:2.0:1790100445.415725:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b58e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126256640:0@lo:400:kworker.0 00000100:00080000:0.0:1790100445.416004:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100445.416009:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100445.416021:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126256896:0@lo:400:kworker.0 00000100:00100000:0.0:1790100445.416051:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100445.416116:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6783504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126256384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100445.416129:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790100445.416144:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b58e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126256512:0@lo:400:kworker.0 00000100:00100000:0.0:1790100445.416172:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100445.416204:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126257024:0@lo:400:kworker.0 00000100:00100000:0.0:1790100445.416223:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100445.416246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126257024 00000100:00100000:0.0:1790100445.416250:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126257024 00000100:00100000:0.0:1790100445.416274:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790100445.416280:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126257024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100445.416471:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126256896 00000100:00100000:3.0:1790100445.416476:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126256896 00000100:00100000:3.0:1790100445.416506:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790100445.416512:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126256896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100445.416549:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126256896:12345-0@lo:400:kworker.0 Request processed in 37us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100445.416556:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1790100445.416586:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790100445.416588:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100445.416731:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126257024:12345-0@lo:400:kworker.0 Request processed in 451us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100445.416738:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790100445.416760:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126257024:0@lo:400:kworker.0 00000100:00100000:0.0:1790100445.416769:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126256896:0@lo:400:kworker.0 00000100:00100000:2.0:1790100445.417010:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126256512 00000100:00100000:2.0:1790100445.417020:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126256512 00000100:00100000:2.0:1790100445.417051:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1790100445.417068:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126256512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100445.417110:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126256512:12345-0@lo:400:kworker.0 Request processed in 53us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100445.417116:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1790100445.417562:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b58e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126256512:0@lo:400:kworker.0 00010000:00010000:1.0:1790100445.477761:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100445.569947:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100445.570111:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109476224 00000100:00100000:2.0:1790100445.570128:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109476224 00000100:00100000:2.0:1790100445.570202:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 136 00000100:00100000:2.0:1790100445.570213:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:11319:x1877056109476224:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100445.570238:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100445.570261:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd82b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64de5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.570340:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.570359:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.570372:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.570425:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.570433:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.570439:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.571863:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd840 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.571878:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd840 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.571887:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd840 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100445.571898:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790100445.572042:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572051:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572071:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572077:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100445.572081:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572088:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572103:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d6799df4500) 00010000:00010000:2.0:1790100445.572106:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100445.572111:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572130:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd832 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572142:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572147:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572152:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572157:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100445.572161:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572166:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572174:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d6787deff00) 00010000:00010000:2.0:1790100445.572176:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100445.572179:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572184:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefd839 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572548:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefd82b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64de5 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572564:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd840 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64de5 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100445.572578:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:2.0:1790100445.572581:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100445.572584:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142200, rc 0) 00000100:00100000:2.0:1790100445.574132:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:11319:x1877056109476224:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 3915us (4194us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1790100445.574144:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 136 00000100:00100000:1.0:1790100445.578536:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100445.578649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109476352 00000100:00100000:3.0:1790100445.578660:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109476352 00000100:00100000:3.0:1790100445.578721:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 137 00000100:00100000:3.0:1790100445.578733:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:11319:x1877056109476352:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790100445.578920:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:11319:x1877056109476352:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 Request processed in 188us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100445.578928:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 137 00000100:00100000:1.0:1790100445.592112:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100445.592244:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109476480 00000100:00100000:0.0:1790100445.592255:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109476480 00000100:00100000:0.0:1790100445.592339:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:0.0:1790100445.592363:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:2360:x1877056109476480:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100445.592379:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100445.592404:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd840 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64de5 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100445.592424:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:0.0:1790100445.592430:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100445.592718:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b16aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:2360:x1877056109476480:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 356us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100445.592741:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1790100446.443410:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100446.443439:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126257152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100446.443524:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100446.443594:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126257152 00000100:00100000:2.0:1790100446.443605:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126257152 00000100:00100000:2.0:1790100446.443680:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790100446.443690:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126257152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100446.443734:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100446.443805:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126257152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100446.443812:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790100446.444172:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126257152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790100446.501895:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100446.503584:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100446.503591:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100446.504543:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1790100446.504560:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790100447.612766:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100448.613950:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100448.677923:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100448.677932:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100448.678456:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1790100448.678463:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790100448.920470:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100448.920643:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109476608 00000100:00100000:2.0:1790100448.920662:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109476608 00000100:00100000:2.0:1790100448.920758:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 138 00000100:00100000:2.0:1790100448.920800:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:11362:x1877056109476608:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100448.920821:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100448.920879:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd84e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64dec expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.920949:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.920966:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.920980:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921009:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921017:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921025:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921249:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921259:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921268:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921286:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100448.921291:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921302:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921317:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1b00) 00010000:00010000:2.0:1790100448.921321:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100448.921326:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921333:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd855 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921347:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921354:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921361:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921366:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100448.921369:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921375:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921395:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d6787deff00) 00010000:00010000:2.0:1790100448.921398:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100448.921401:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921407:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd85c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921580:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd84e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dec expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921592:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1b00) 00010000:00010000:2.0:1790100448.921594:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100448.921598:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd84e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dec expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100448.921607:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143c00, rc 0) 00000100:00100000:2.0:1790100448.921693:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:11362:x1877056109476608:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 898us (1235us total) trans 0 rc 301/301 00000100:00100000:2.0:1790100448.921701:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 138 00000100:00080000:0.0:1790100448.921801:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100449.229425:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100449.229546:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109476864 00000100:00100000:2.0:1790100449.229555:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109476864 00000100:00100000:2.0:1790100449.229922:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 139 00000100:00100000:2.0:1790100449.229932:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:11362:x1877056109476864:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:2.0:1790100449.229989:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100449.230090:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd1da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c2c expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.230125:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1b00) 00010000:00010000:2.0:1790100449.230135:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100449.230376:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.230389:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.230397:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.230407:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.230412:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.230418:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100449.231176:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790100449.231185:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.231191:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.231197:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.231202:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100449.231211:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.231218:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.231232:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:2.0:1790100449.231235:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100449.231238:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.231243:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd863 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100449.231255:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b460cd55 reply state 0000000097a1bbca transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100449.231262:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100449.231337:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:11362:x1877056109476864:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 1406us (1919us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1790100449.231344:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 139 00010000:00010000:2.0:1790100449.239739:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.239754:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.239761:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.239767:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100449.239771:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.239789:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.239805:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d6787def000) 00010000:00010000:2.0:1790100449.239808:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100449.239812:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.239817:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefd86a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100449.362820:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100449.362908:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109476992 00000100:00100000:3.0:1790100449.362918:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109476992 00000100:00100000:3.0:1790100449.363008:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 140 00000100:00100000:3.0:1790100449.363017:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:11370:x1877056109476992:12345-192.168.201.18@tcp:101:lctl.0 00010000:00010000:3.0:1790100449.363040:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100449.363061:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd871 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64df3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.363121:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd878 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.363134:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd878 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.363144:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd878 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100449.363175:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790100449.363178:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100449.363194:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd878 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.363214:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd871 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64df3 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.363242:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd878 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64df3 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.363267:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:3.0:1790100449.363269:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100449.363273:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae600, rc 0) 00000100:00100000:3.0:1790100449.363360:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:11370:x1877056109476992:12345-192.168.201.18@tcp:101:lctl.0 Request processed in 344us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100449.363366:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 140 00000100:00100000:2.0:1790100449.535513:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100449.535593:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109477120 00000100:00100000:3.0:1790100449.535605:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109477120 00000100:00100000:3.0:1790100449.535685:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 141 00000100:00100000:3.0:1790100449.535697:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+15:11376:x1877056109477120:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1790100449.535717:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100449.535735:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd87f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64dfa expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.535798:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.535813:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.535827:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.535842:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.535850:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.535872:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536275:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd894 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536286:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536293:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100449.536318:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790100449.536321:0:6711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100449.536341:0:6711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536353:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536360:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536368:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536375:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aea00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100449.536379:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536386:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536406:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:3.0:1790100449.536409:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100449.536415:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536423:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd886 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536436:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536442:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536449:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536455:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100449.536458:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536464:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536471:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d6787ec1400) 00010000:00010000:3.0:1790100449.536473:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100449.536477:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536483:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd88d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536525:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd87f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dfa expref: 17 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536539:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd894 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dfa expref: 16 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100449.536546:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100449.536548:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790100449.536551:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae200, rc 0) 00000100:00100000:3.0:1790100449.536729:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:11376:x1877056109477120:12345-192.168.201.18@tcp:101:bash.0 Request processed in 1034us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100449.536738:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 141 00000001:00080000:3.0:1790100449.538434:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000100:00100000:0.0:1790100449.552208:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100449.552319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109477376 00000100:00100000:2.0:1790100449.552331:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109477376 00000100:00100000:2.0:1790100449.552393:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 142 00000100:00100000:2.0:1790100449.552404:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:11376:x1877056109477376:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1790100449.552425:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100449.552445:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd89b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e01 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.552772:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.552787:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.552799:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.552858:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.552886:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.552894:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790100449.553558:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1790100449.553841:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.553853:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.553862:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.553896:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.553903:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.553911:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.553916:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100449.553920:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.553929:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.553952:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:2.0:1790100449.553955:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100449.553960:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.553968:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefd8a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100449.553981:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f3a70cf reply state 0000000037d7a55b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100449.554002:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790100449.554033:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefd89b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e01 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.554047:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e01 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.554054:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:2.0:1790100449.554057:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100449.554059:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142600, rc 0) 00000100:00100000:2.0:1790100449.554136:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:11376:x1877056109477376:12345-192.168.201.18@tcp:101:bash.0 Request processed in 1733us (1936us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1790100449.554144:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 142 00010000:00010000:0.0:1790100449.559028:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.559047:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.559056:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.559062:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100449.559068:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.559076:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.559092:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787def000) 00010000:00010000:0.0:1790100449.559096:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100449.559101:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.559107:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefd8a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100449.581346:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100449.581468:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109477504 00000100:00100000:1.0:1790100449.581479:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109477504 00000100:00100000:1.0:1790100449.581555:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:1.0:1790100449.581566:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2359:x1877056109477504:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1790100449.581594:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100449.581660:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e08 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100449.581687:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790100449.581706:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1790100449.581711:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100449.581721:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e08 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.581741:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e08 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.581754:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13a00, rc 0) 00000100:00100000:1.0:1790100449.581805:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2359:x1877056109477504:12345-192.168.201.18@tcp:101:bash.0 Request processed in 240us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100449.581821:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00080000:0.0:1790100449.582053:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100449.590075:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100449.590543:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109477632 00000100:00100000:3.0:1790100449.590554:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109477632 00000100:00100000:0.0:1790100449.590769:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:0.0:1790100449.590782:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:11376:x1877056109477632:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1790100449.590803:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100449.590822:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e0f expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.590856:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e08 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.590879:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100449.590884:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100449.590890:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.590924:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e08 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.590938:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e08 expref: 7 pid: 6689 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100449.590952:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf39b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1877056126257280:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100449.591055:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6781359540 going to sleep for 11 seconds 00000100:00100000:0.0:1790100449.600706:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf39b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1877056126257280:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100449.600746:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100449.600785:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818a00, rc 0) 00000100:00100000:0.0:1790100449.600849:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:11376:x1877056109477632:12345-192.168.201.18@tcp:101:bash.0 Request processed in 10069us (10782us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100449.600859:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:1.0:1790100449.621828:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100449.622843:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109477760 00000100:00100000:2.0:1790100449.622855:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109477760 00010000:00010000:2.0:1790100449.622968:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e08 expref: 7 pid: 6689 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100449.623086:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:2.0:1790100449.623097:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109477760:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100449.623125:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100449.623148:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e08 expref: 7 pid: 6689 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.623169:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e08 expref: 7 pid: 6689 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.623194:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefd8be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e08 expref: 7 pid: 6689 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.623211:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100449.623215:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100449.623223:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.623242:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100449.623290:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100449.623305:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1877056126257408:192.168.201.18@tcp:105: 00000100:00100000:2.0:1790100449.623400:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00cc00 going to sleep for 11 seconds 00010000:00010000:2.0:1790100449.645654:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100449.660192:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100449.661040:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109478016 00000100:00100000:3.0:1790100449.661050:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109478016 00000100:00100000:3.0:1790100449.661112:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:3.0:1790100449.661123:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+16:11376:x1877056109478016:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:3.0:1790100449.661468:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:11376:x1877056109478016:12345-192.168.201.18@tcp:35:bash.0 Request processed in 346us (1285us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1790100449.661477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1790100449.661769:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1877056126257408:192.168.201.18@tcp:105: 00010000:00010000:0.0:1790100449.661792:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100449.661827:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109477760:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 38732us (40007us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100449.661835:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:2.0:1790100449.840657:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100449.840692:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100449.840727:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100449.840761:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109478272 00000100:00100000:2.0:1790100449.840771:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109478272 00000100:00100000:2.0:1790100449.840829:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:2.0:1790100449.840839:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109478272:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100449.840857:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109478144 00000100:00100000:0.0:1790100449.840861:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109478144 00000100:00100000:0.0:1790100449.840889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 287 00000100:00100000:0.0:1790100449.840895:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2360:x1877056109478144:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100449.840908:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2360:x1877056109478272:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100449.840916:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:0.0:1790100449.840918:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2360:x1877056109478144:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100449.840923:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 287 00000100:00080000:2.0:1790100449.840940:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100449.841022:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109478400 00000100:00100000:3.0:1790100449.841027:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109478400 00000100:00100000:3.0:1790100449.841073:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 135 00000100:00100000:3.0:1790100449.841079:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2360:x1877056109478400:12345-192.168.201.18@tcp:400:kworker.0 00000100:00080000:0.0:1790100449.841175:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100449.842302:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25abe39-6b64-46c4-a568-4506410538f0+5:2360:x1877056109478400:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 1219us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100449.842311:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 135 00000100:00100000:3.0:1790100449.905857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100449.906028:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109478656 00000100:00100000:1.0:1790100449.906038:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109478656 00000100:00100000:1.0:1790100449.906095:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 143 00000100:00100000:1.0:1790100449.906103:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:11386:x1877056109478656:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100449.906238:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100449.906259:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd8cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e16 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100449.906348:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790100449.906471:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd8cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e16 expref: 19 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.906484:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:1.0:1790100449.906487:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100449.906795:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd8cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e16 expref: 19 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100449.906810:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13000, rc 0) 00000100:00100000:1.0:1790100449.907067:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:11386:x1877056109478656:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 963us (1217us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1790100449.907076:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 143 00000100:00100000:2.0:1790100449.924002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100449.924083:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109478912 00000100:00100000:3.0:1790100449.924094:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109478912 00000100:00100000:3.0:1790100449.924154:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:3.0:1790100449.924164:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:11386:x1877056109478912:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100449.924404:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:11386:x1877056109478912:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 241us (410us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1790100449.924411:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:0.0:1790100450.119996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100450.120109:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109479040 00000100:00100000:1.0:1790100450.120121:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109479040 00000100:00080000:0.0:1790100450.120275:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100450.120353:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00100000:1.0:1790100450.120364:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:11391:x1877056109479040:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100450.120402:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100450.120422:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd8da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e1d expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.120489:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd8e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.120503:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.120515:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100450.120550:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790100450.120554:0:11548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100450.120572:0:11548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.120597:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd8da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e1d expref: 21 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.120644:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e1d expref: 20 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.120653:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:1.0:1790100450.120656:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100450.120660:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12600, rc 0) 00000100:00100000:1.0:1790100450.120773:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:11391:x1877056109479040:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 410us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.120792:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00100000:0.0:1790100450.128368:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100450.128508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109479296 00000100:00100000:2.0:1790100450.128520:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109479296 00000100:00100000:2.0:1790100450.128654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 145 00000100:00100000:2.0:1790100450.128666:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:11391:x1877056109479296:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100450.128687:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100450.128710:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd8e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e24 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.128814:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd8ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.128829:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.128857:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100450.128871:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790100450.129018:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd8e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e24 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.129035:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e24 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.129042:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:2.0:1790100450.129045:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100450.129048:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143a00, rc 0) 00000100:00100000:2.0:1790100450.129111:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:11391:x1877056109479296:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 448us (753us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1790100450.129119:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 145 00000100:00100000:3.0:1790100450.135374:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100450.135519:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109479552 00000100:00100000:1.0:1790100450.135532:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109479552 00000100:00100000:1.0:1790100450.135599:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 146 00000100:00100000:1.0:1790100450.135631:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:11391:x1877056109479552:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100450.135658:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100450.135680:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd8fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e2b expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.135778:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd904 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.135794:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.135807:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd904 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100450.135820:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790100450.135934:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd8fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e2b expref: 25 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.135952:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd904 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e2b expref: 24 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.135961:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:1.0:1790100450.135964:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790100450.135968:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12a00, rc 0) 00000100:00100000:1.0:1790100450.136236:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:11391:x1877056109479552:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 627us (870us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1790100450.136244:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 146 00000100:00100000:0.0:1790100450.137238:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100450.137345:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109479680 00000100:00100000:2.0:1790100450.137354:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109479680 00000100:00100000:2.0:1790100450.137442:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:2.0:1790100450.137453:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:2360:x1877056109479680:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100450.137466:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100450.137486:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefd8ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e24 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.137501:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:2.0:1790100450.137505:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100450.137559:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:2360:x1877056109479680:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 107us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.137565:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1790100450.183416:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100450.183527:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109479808 00000100:00100000:3.0:1790100450.183537:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109479808 00000100:00100000:3.0:1790100450.183655:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:3.0:1790100450.183666:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109479808:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:3.0:1790100450.183712:0:12004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.183732:0:12004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.183740:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100450.183745:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100450.183749:0:12004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.183786:0:12004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.183821:0:12004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 6 pid: 6687 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100450.183837:0:12004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12004:1877056126257536:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100450.183964:0:12004:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6781254b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100450.200338:0:12004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12004:1877056126257536:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100450.200371:0:12004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100450.205542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100450.205765:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109479936 00000100:00100000:2.0:1790100450.205775:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109479936 00002000:00100000:2.0:1790100450.205827:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d67bf39aa00 x1877056109479936/t0(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:746/0 lens 504/0 e 0 to 0 dl 1790100461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100450.205839:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf39aa00 with x1877056109479936 ext(0->12) 00010000:00010000:2.0:1790100450.205848:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 7 pid: 6687 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.205865:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 7 pid: 6687 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790100450.205873:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d67bf39aa00 00000100:00100000:2.0:1790100450.205939:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:2.0:1790100450.205950:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2357:x1877056109479936:12345-192.168.201.18@tcp:4:lfs.0 00000100:00100000:2.0:1790100450.206643:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2357:x1877056109479936:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 692us (1108us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790100450.206652:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00002000:00100000:2.0:1790100450.206659:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d67bf39aa00 x1877056109479936/t4294967305(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:746/0 lens 504/448 e 0 to 0 dl 1790100461 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100450.206667:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf39aa00 with x1877056109479936 ext(0->12) 00010000:00010000:2.0:1790100450.206674:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 9 pid: 6687 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.206700:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 9 pid: 6687 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790100450.206707:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d67bf39aa00 00000100:00100000:3.0:1790100450.214260:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100450.214475:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109480064 00000100:00100000:2.0:1790100450.214486:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109480064 00010000:00010000:2.0:1790100450.214532:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 9 pid: 6687 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.214655:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:2.0:1790100450.214666:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2359:x1877056109480064:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100450.214681:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790100450.214701:0:12013:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790100450.214704:0:12013:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790100449 00002000:00010000:2.0:1790100450.214707:0:12013:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790100449 00002000:00010000:2.0:1790100450.214708:0:12013:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790100449 00010000:00010000:2.0:1790100450.214714:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 9 pid: 6687 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.214726:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 9 pid: 6687 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.214748:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfcc521e/0x31a8f3fdeeefd8c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e0f expref: 9 pid: 6687 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.214783:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100450.214787:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100450.214793:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.214804:0:12013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.214841:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100450.214907:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2359:x1877056109480064:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 242us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.214915:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00010000:00010000:3.0:1790100450.214972:0:12004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.215008:0:12004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.215034:0:12004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.215043:0:12004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.215052:0:12004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.215059:0:12004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100450.215064:0:12004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.215085:0:12004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.215097:0:12004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.215118:0:12004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefd912 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100450.215163:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109479808:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 31498us (31756us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100450.215171:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:3.0:1790100450.217870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100450.217947:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109480320 00000100:00100000:2.0:1790100450.217958:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109480320 00000100:00100000:2.0:1790100450.218035:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:2.0:1790100450.218047:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d679e03bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:11391:x1877056109480320:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:2.0:1790100450.218106:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd904 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e2b expref: 23 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100450.218505:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1790100450.218546:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1790100450.219137:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1790100450.219190:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.219205:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e01 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.219286:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.219324:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e01 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.219339:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e01 expref: 27 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.219353:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1877056126257664:192.168.201.18@tcp:104: 00000100:00100000:2.0:1790100450.219471:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d679135c300 going to sleep for 11 seconds 00000100:00100000:2.0:1790100450.222843:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1877056126257664:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100450.222875:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100450.223068:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100450.223131:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109480448 00000100:00100000:0.0:1790100450.223138:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109480448 00010000:00010000:0.0:1790100450.223175:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e01 expref: 28 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100450.223589:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:0.0:1790100450.223600:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:2357:x1877056109480448:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100450.223638:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100450.223646:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e01 expref: 28 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.223659:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e01 expref: 28 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.223680:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefd8b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e01 expref: 28 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.223694:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:0.0:1790100450.223699:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.223723:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.223731:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.223772:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100450.223824:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:2357:x1877056109480448:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 225us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100450.223832:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00010000:00010000:1.0:1790100450.223884:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.223892:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100450.224125:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1790100450.224424:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1790100450.224527:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b168000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1877056126257792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790100450.224594:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100450.224636:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790100450.224654:0:12069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126257792 00000100:00100000:1.0:1790100450.224659:0:12069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126257792 00000100:00100000:1.0:1790100450.224694:0:12069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100450.224700:0:12069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5845:x1877056126257792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790100450.224859:0:12069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5845:x1877056126257792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 158us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.224866:0:12069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100450.224899:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b168000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1877056126257792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790100450.225577:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1790100450.228361:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b168000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1877056126257920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790100450.228429:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100450.228463:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100450.228494:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126257920 00000100:00100000:1.0:1790100450.228501:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126257920 00000100:00100000:1.0:1790100450.228561:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100450.228569:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1877056126257920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1790100450.229896:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100450.230563:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1877056126257920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1991us (2130us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790100450.230573:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790100450.230826:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b168000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1877056126257920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790100450.230911:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1790100450.230957:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.230967:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.230986:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.230992:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100450.231002:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.231011:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.231093:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:2.0:1790100450.231097:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790100450.231167:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.231175:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd919 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790100450.231450:0:5845:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790100450.231552:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1790100450.231560:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346800948998ns, next at 347800947207ns, rc = 0 00000001:00080000:2.0:1790100450.231566:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1790100450.231594:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:2.0:1790100450.231598:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790100450.231605:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefd904 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e2b expref: 31 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.231932:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d679e03bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+30:11391:x1877056109480320:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 13886us (14068us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1790100450.231940:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00000020:00080000:2.0:1790100450.231945:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790100450.235421:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100450.235524:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109480576 00000100:00100000:1.0:1790100450.235535:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109480576 00000100:00100000:1.0:1790100450.235651:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 147 00000100:00100000:1.0:1790100450.235663:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+30:11391:x1877056109480576:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100450.235687:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100450.235710:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd920 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e32 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.235893:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd920 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e32 expref: 31 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.235910:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd920 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e32 expref: 31 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.235930:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100450.235934:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100450.235937:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13000, rc 0) 00000100:00100000:1.0:1790100450.236010:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:11391:x1877056109480576:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 349us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.236018:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 147 00000100:00100000:0.0:1790100450.244795:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100450.244885:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109480832 00000100:00100000:3.0:1790100450.244897:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109480832 00000100:00100000:3.0:1790100450.244950:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:3.0:1790100450.244960:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:11391:x1877056109480832:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100450.245241:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:11391:x1877056109480832:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 281us (455us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1790100450.245248:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:2.0:1790100450.346568:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100450.346709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109481088 00000100:00100000:0.0:1790100450.346720:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109481088 00000100:00100000:0.0:1790100450.346799:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00100000:0.0:1790100450.346811:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:11402:x1877056109481088:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100450.346836:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100450.346857:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd927 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e39 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100450.346949:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790100450.347375:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd927 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e39 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.347389:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:0.0:1790100450.347392:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790100450.347397:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefd927 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e39 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100450.347429:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819200, rc 0) 00000100:00100000:0.0:1790100450.347495:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+33:11402:x1877056109481088:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 685us (936us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1790100450.347502:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00100000:0.0:1790100450.355998:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100450.356305:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109481216 00000100:00100000:1.0:1790100450.356317:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109481216 00000100:00100000:1.0:1790100450.356395:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 149 00000100:00100000:1.0:1790100450.356406:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+33:11402:x1877056109481216:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:1.0:1790100450.356480:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356498:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356509:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356525:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356532:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356539:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356660:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356669:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356676:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100450.356713:0:6711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356725:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356737:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356744:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356750:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100450.356755:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356763:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356775:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:1.0:1790100450.356778:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100450.356782:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356788:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd935 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356801:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356807:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356813:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356818:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100450.356825:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356832:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356838:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6799df4100) 00010000:00010000:1.0:1790100450.356840:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100450.356843:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356848:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd93c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356861:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356867:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356874:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356878:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100450.356881:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356886:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356892:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100450.356894:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100450.356901:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.356907:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd943 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100450.357158:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+33:11402:x1877056109481216:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 753us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.357166:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 149 00000100:00100000:0.0:1790100450.360051:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100450.360180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109481472 00000100:00100000:3.0:1790100450.360191:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109481472 00000100:00100000:3.0:1790100450.360270:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:3.0:1790100450.360280:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+33:11402:x1877056109481472:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100450.360506:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+34:11402:x1877056109481472:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 226us (462us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1790100450.360514:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:2.0:1790100450.402831:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100450.402931:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109481728 00000100:00100000:1.0:1790100450.402941:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109481728 00000100:00100000:1.0:1790100450.403007:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 150 00000100:00100000:1.0:1790100450.403017:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+34:11405:x1877056109481728:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100450.403048:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100450.403068:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd94a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e40 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403160:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403175:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403187:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403201:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403305:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403333:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403443:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403454:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403461:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100450.403471:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790100450.403566:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403575:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403581:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403587:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100450.403592:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403600:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403660:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:1.0:1790100450.403664:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100450.403677:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403684:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefd951 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403697:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403703:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403708:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403713:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100450.403717:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403722:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403731:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6799df4100) 00010000:00010000:1.0:1790100450.403734:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100450.403736:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403742:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403783:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd94a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e40 expref: 37 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403809:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e40 expref: 36 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.403816:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100450.403818:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100450.403821:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12000, rc 0) 00000100:00100000:1.0:1790100450.403874:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:11405:x1877056109481728:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 858us (1051us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1790100450.403881:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 150 00000100:00100000:0.0:1790100450.408894:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100450.408991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109481856 00000100:00100000:2.0:1790100450.409013:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109481856 00000100:00100000:2.0:1790100450.409079:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 151 00000100:00100000:2.0:1790100450.409090:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:11405:x1877056109481856:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1790100450.409158:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.409174:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.409185:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.409368:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.409377:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.409383:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.409389:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100450.409394:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.409402:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.409415:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:2.0:1790100450.409418:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100450.409422:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.409440:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd96d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.409516:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:11405:x1877056109481856:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 428us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.409523:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 151 00000100:00100000:0.0:1790100450.412440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100450.412568:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109482112 00000100:00100000:3.0:1790100450.412578:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109482112 00000100:00100000:3.0:1790100450.412656:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:3.0:1790100450.412667:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:11405:x1877056109482112:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100450.412893:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+37:11405:x1877056109482112:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 227us (459us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1790100450.412901:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:1.0:1790100450.534035:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100450.534058:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126258048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100450.534137:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100450.534587:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126258048 00000100:00100000:3.0:1790100450.534596:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126258048 00000100:00100000:3.0:1790100450.534693:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790100450.534703:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126258048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100450.534736:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100450.534784:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126258048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100450.534791:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1790100450.534865:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100450.534941:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126258048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100450.535515:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126258176:0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.535550:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100450.535586:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126258688:0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.535629:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100450.535650:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790100450.535657:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126258304:0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.535680:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100450.535701:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126258432:0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.535720:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100450.535734:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100450.535739:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126258560:0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.535774:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100450.535801:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126258688 00000100:00100000:1.0:1790100450.535807:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126258688 00000100:00100000:1.0:1790100450.535840:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126258304 00000100:00100000:1.0:1790100450.535843:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126258304 00000100:00100000:1.0:1790100450.535870:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126258432 00000100:00100000:1.0:1790100450.535873:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126258432 00000100:00100000:1.0:1790100450.535886:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790100450.535892:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b16bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126258688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.535932:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b16bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126258688:12345-0@lo:400:kworker.0 Request processed in 40us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.535939:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790100450.535951:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790100450.535956:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126258304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100450.536196:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790100450.536217:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b16b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126258432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100450.536454:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126258176 00000100:00100000:0.0:1790100450.536459:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126258176 00000100:00100000:0.0:1790100450.536484:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1790100450.536491:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126258176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100450.536567:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126258560 00000100:00100000:2.0:1790100450.536573:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126258560 00000100:00100000:2.0:1790100450.536601:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790100450.536607:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126258560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.538227:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126258304:12345-0@lo:400:kworker.0 Request processed in 2266us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.538239:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1790100450.538273:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100450.538305:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126258304:0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.538318:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126258688:0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.538353:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126258432:0@lo:400:kworker.0 00000100:00100000:3.0:1790100450.554389:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b16b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126258432:12345-0@lo:400:kworker.0 Request processed in 18177us (18658us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100450.554404:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790100450.556908:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126258176:12345-0@lo:400:kworker.0 Request processed in 20409us (21348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100450.556923:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1790100450.557605:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126258176:0@lo:400:kworker.0 00000100:00100000:1.0:1790100450.557688:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126258560:12345-0@lo:400:kworker.0 Request processed in 21080us (21912us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100450.557697:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790100450.559306:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126258560:0@lo:400:kworker.0 00010000:00010000:1.0:1790100450.663030:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100450.821223:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100450.822125:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109482368 00000100:00100000:2.0:1790100450.822137:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109482368 00000100:00100000:2.0:1790100450.822212:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 152 00000100:00100000:2.0:1790100450.822222:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+37:11436:x1877056109482368:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:2.0:1790100450.822247:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100450.822274:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd974 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e47 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.822374:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd97b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.822389:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.822402:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100450.822431:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790100450.822576:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd974 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e47 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.822596:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd97b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e47 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.822605:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:2.0:1790100450.822773:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100450.822778:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143400, rc 0) 00000100:00100000:2.0:1790100450.822842:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:11436:x1877056109482368:12345-192.168.201.18@tcp:101:cat.0 Request processed in 621us (1627us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1790100450.822850:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 152 00000100:00100000:0.0:1790100450.831304:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100450.831423:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109482496 00000100:00100000:2.0:1790100450.831435:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109482496 00000100:00100000:2.0:1790100450.831546:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:2.0:1790100450.831558:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:2358:x1877056109482496:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100450.831575:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100450.831601:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd97b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e47 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.831646:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:2.0:1790100450.831652:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100450.831719:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:2358:x1877056109482496:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 164us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.831727:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1790100450.833348:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100450.833416:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109482752 00000100:00100000:3.0:1790100450.833425:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109482752 00000100:00100000:3.0:1790100450.833469:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:3.0:1790100450.833478:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:11436:x1877056109482752:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:3.0:1790100450.833721:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:11436:x1877056109482752:12345-192.168.201.18@tcp:35:cat.0 Request processed in 244us (377us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1790100450.833728:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:0.0:1790100450.906709:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100450.906809:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109483008 00000100:00100000:1.0:1790100450.906821:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109483008 00000100:00100000:1.0:1790100450.906885:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 153 00000100:00100000:1.0:1790100450.906896:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:11442:x1877056109483008:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:1.0:1790100450.906921:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100450.906925:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790100450.906950:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd8e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e1d expref: 39 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.907081:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:1.0:1790100450.907087:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100450.907104:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd989 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e4e expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.907291:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.907305:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e40 expref: 39 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.907313:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.907350:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e40 expref: 39 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.907364:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e40 expref: 39 pid: 11548 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100450.907399:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b168a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6711:1877056126258816:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100450.907543:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fe70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100450.911477:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100450.911607:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b168a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6711:1877056126258816:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100450.911655:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.913780:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109483136 00000100:00100000:2.0:1790100450.913794:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109483136 00010000:00010000:2.0:1790100450.913843:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e40 expref: 40 pid: 11548 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100450.914017:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:2.0:1790100450.914030:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+40:2357:x1877056109483136:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100450.914047:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100450.914054:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e40 expref: 40 pid: 11548 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.914068:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e40 expref: 40 pid: 11548 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.914091:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefd95f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e40 expref: 40 pid: 11548 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.914108:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:2.0:1790100450.914113:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.914123:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.914130:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.914161:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100450.914231:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:2357:x1877056109483136:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 205us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100450.914253:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00010000:00010000:1.0:1790100450.914440:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.914448:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100450.914467:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790100450.914646:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd989 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e4e expref: 40 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.914662:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e4e expref: 39 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100450.914669:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100450.914672:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790100450.914674:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13e00, rc 0) 00000100:00100000:1.0:1790100450.914717:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:11442:x1877056109483008:12345-192.168.201.18@tcp:101:dd.0 Request processed in 7823us (8015us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1790100450.914725:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 153 00000100:00100000:0.0:1790100450.918432:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100450.918525:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109483392 00000100:00100000:3.0:1790100450.918536:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109483392 00000100:00100000:3.0:1790100450.918658:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 154 00000100:00100000:3.0:1790100450.918669:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:11442:x1877056109483392:12345-192.168.201.18@tcp:36:dd.0 00010000:00010000:3.0:1790100450.918924:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.918941:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100450.918953:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100450.919016:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1790100450.919041:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c39b6c9 reply state 000000004e176f2d transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100450.919049:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100450.919147:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+42:11442:x1877056109483392:12345-192.168.201.18@tcp:36:dd.0 Request processed in 480us (724us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1790100450.919155:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 154 00000020:00080000:3.0:1790100450.919174:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790100450.921428:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.921445:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.921453:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.921459:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100450.921464:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.921472:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.921489:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:2.0:1790100450.921492:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100450.921498:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100450.921504:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefd99e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100451.454728:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100451.455515:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109483520 00000100:00100000:2.0:1790100451.455529:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109483520 00000100:00100000:2.0:1790100451.455605:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 155 00000100:00100000:2.0:1790100451.455663:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+41:11456:x1877056109483520:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:2.0:1790100451.455693:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100451.455747:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd9a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e55 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.455915:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.455933:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.455949:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.455978:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.455986:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.455993:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.456112:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.456125:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e4e expref: 42 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.456135:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.456548:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e4e expref: 42 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.456580:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e4e expref: 42 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100451.456597:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126258944:192.168.201.18@tcp:104: 00000100:00100000:2.0:1790100451.456755:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100451.461200:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100451.461390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109483776 00000100:00100000:3.0:1790100451.461402:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109483776 00000100:00100000:3.0:1790100451.461474:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:3.0:1790100451.461485:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:5593:x1877056109483776:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790100451.461941:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+44:5593:x1877056109483776:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 457us (760us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1790100451.461950:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:2.0:1790100451.462969:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126258944:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100451.463007:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100451.465720:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100451.465907:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109483904 00000100:00100000:3.0:1790100451.465918:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109483904 00010000:00010000:3.0:1790100451.465976:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e4e expref: 44 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100451.466020:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:3.0:1790100451.466030:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+44:2357:x1877056109483904:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100451.466050:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100451.466057:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e4e expref: 44 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.466070:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e4e expref: 44 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.466701:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefd990 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e4e expref: 44 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.466723:0:12013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:3.0:1790100451.466910:0:12013:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.466921:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.466929:0:12013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100451.467008:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100451.467077:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:2357:x1877056109483904:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 1047us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100451.467094:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00010000:00010000:2.0:1790100451.475704:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475729:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100451.475808:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790100451.475814:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100451.475851:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475870:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475882:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475890:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475918:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475925:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100451.475930:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475939:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475964:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:2.0:1790100451.475968:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100451.475973:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475980:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefd9ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.475999:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.476006:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.476011:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.476017:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100451.476020:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.476036:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.476045:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787deff00) 00010000:00010000:2.0:1790100451.476047:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100451.476051:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.476057:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefd9b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.476571:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd9a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e55 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.476589:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e55 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.476598:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:2.0:1790100451.476600:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100451.476603:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142200, rc 0) 00000100:00100000:2.0:1790100451.476714:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+42:11456:x1877056109483520:12345-192.168.201.18@tcp:101:stat.0 Request processed in 21054us (21999us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100451.476724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 155 00000004:00080000:2.0:1790100451.558457:0:6834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348127842012ns, next at 349127838361ns, rc = 0 00000100:00100000:3.0:1790100451.560337:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126259072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100451.560441:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100451.567054:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126259072 00000100:00100000:2.0:1790100451.567079:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126259072 00000100:00100000:2.0:1790100451.567181:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790100451.567202:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126259072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100451.567272:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100451.567393:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126259072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (6951us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100451.567401:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790100451.567934:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126259072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100451.671731:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100451.671936:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109484160 00000100:00100000:1.0:1790100451.671975:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109484160 00000100:00100000:1.0:1790100451.672059:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 156 00000100:00100000:1.0:1790100451.672071:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+42:11462:x1877056109484160:12345-192.168.201.18@tcp:36:truncate.0 00010000:00010000:1.0:1790100451.672175:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100451.672218:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142200/0x31a8f3fdeeefd9ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e55 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.672240:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100451.672246:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100451.672528:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.672545:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.672557:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100451.672670:0:6711:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1790100451.672702:0:6711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020848648 reply state 00000000e04b2332 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100451.672710:0:6711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790100451.673711:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+44:11462:x1877056109484160:12345-192.168.201.18@tcp:36:truncate.0 Request processed in 1634us (1986us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1790100451.673723:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 156 00000020:00080000:1.0:1790100451.673729:0:6711:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790100451.687169:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.687201:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.687232:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.687240:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100451.687245:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.687254:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.687275:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100451.687279:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100451.687284:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100451.687292:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100451.696308:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100452.018044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.018532:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109484288 00000100:00100000:3.0:1790100452.018546:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109484288 00000100:00100000:3.0:1790100452.018785:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 157 00000100:00100000:3.0:1790100452.018798:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:11476:x1877056109484288:12345-192.168.201.18@tcp:101:stat.0 00010000:00010000:3.0:1790100452.018831:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100452.018856:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd9c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e5c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.018954:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.018971:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.018997:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019016:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019024:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019031:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019149:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019158:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019165:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100452.019311:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1790100452.019317:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100452.019343:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019356:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019365:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019384:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019390:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019397:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aea00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100452.019402:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019411:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019424:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100452.019428:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100452.019433:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019440:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefd9cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019458:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019464:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019470:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019475:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100452.019484:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019490:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019498:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787ec1d00) 00010000:00010000:3.0:1790100452.019501:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100452.019504:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019510:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefd9d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019548:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefd9c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e5c expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019563:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e5c expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.019570:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:3.0:1790100452.019573:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100452.019575:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af600, rc 0) 00000100:00100000:3.0:1790100452.019688:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+44:11476:x1877056109484288:12345-192.168.201.18@tcp:101:stat.0 Request processed in 893us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.019696:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 157 00000100:00080000:1.0:1790100452.020846:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100452.121084:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100452.121569:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109484544 00000100:00100000:2.0:1790100452.121583:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109484544 00000100:00100000:2.0:1790100452.121702:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 158 00000100:00100000:2.0:1790100452.121715:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+44:11486:x1877056109484544:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100452.121874:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100452.121902:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd9e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100452.122035:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790100452.122519:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd9e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e63 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.122536:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:2.0:1790100452.122539:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100452.122545:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefd9e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e63 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.122563:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143400, rc 0) 00000100:00100000:2.0:1790100452.122759:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+45:11486:x1877056109484544:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1046us (1700us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1790100452.122768:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 158 00000100:00100000:0.0:1790100452.126550:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.126729:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109484800 00000100:00100000:3.0:1790100452.126851:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109484800 00000100:00100000:3.0:1790100452.126987:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:3.0:1790100452.127001:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d679e038450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+45:11486:x1877056109484800:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100452.127586:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d679e038450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+46:11486:x1877056109484800:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 584us (1045us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1790100452.127596:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:0.0:1790100452.175318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.175445:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109485056 00000100:00100000:1.0:1790100452.175458:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109485056 00000100:00100000:1.0:1790100452.175538:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 159 00000100:00100000:1.0:1790100452.175550:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+46:11492:x1877056109485056:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1790100452.175593:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100452.175658:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e6a expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.175805:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.175848:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e5c expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.175858:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.175901:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e5c expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.175918:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e5c expref: 47 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100452.175953:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b168a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6711:1877056126259200:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100452.176080:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fe70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100452.179084:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b168a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6711:1877056126259200:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100452.179121:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100452.180140:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.180226:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109485184 00000100:00100000:3.0:1790100452.180237:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109485184 00010000:00010000:3.0:1790100452.180287:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e5c expref: 48 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.180329:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:3.0:1790100452.180339:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+48:2358:x1877056109485184:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100452.180356:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100452.180364:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e5c expref: 48 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.180377:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e5c expref: 48 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.180402:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefd9dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e5c expref: 48 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.180421:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:3.0:1790100452.180426:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.180437:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.180445:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.180491:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100452.180546:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:2358:x1877056109485184:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 209us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.180554:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00010000:00010000:1.0:1790100452.180700:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.180709:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100452.180731:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1790100452.180923:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefd9f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e6a expref: 48 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.180962:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e6a expref: 47 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.180970:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100452.180974:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790100452.180976:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12600, rc 0) 00000100:00100000:1.0:1790100452.181003:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:11492:x1877056109485056:12345-192.168.201.18@tcp:101:bash.0 Request processed in 5457us (5703us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1790100452.181010:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 159 00000100:00100000:0.0:1790100452.185143:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.185377:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109485440 00000100:00100000:3.0:1790100452.185390:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109485440 00000100:00100000:3.0:1790100452.185467:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 160 00000100:00100000:3.0:1790100452.185481:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:11492:x1877056109485440:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:3.0:1790100452.185937:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.185970:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.185984:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100452.186046:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1790100452.186084:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f667f3c3 reply state 000000006a933ce9 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.186095:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790100452.186440:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:11492:x1877056109485440:12345-192.168.201.18@tcp:36:bash.0 Request processed in 960us (1310us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1790100452.186449:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 160 00000020:00080000:3.0:1790100452.186455:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790100452.188529:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.188568:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.188578:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.188586:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100452.188592:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.188601:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.188652:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:2.0:1790100452.188657:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100452.188664:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.188671:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefda07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100452.193215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100452.193420:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109485568 00000100:00100000:2.0:1790100452.193433:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109485568 00000100:00100000:2.0:1790100452.193555:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00100000:2.0:1790100452.193567:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+49:11492:x1877056109485568:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1790100452.193597:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100452.193653:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefda0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e71 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.193797:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.193818:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e6a expref: 50 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.193828:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.193867:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e6a expref: 50 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.193882:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e6a expref: 50 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100452.193896:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126259328:192.168.201.18@tcp:104: 00000100:00100000:2.0:1790100452.194001:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00c840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100452.196890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100452.197032:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126259328:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100452.197084:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.197220:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109485696 00000100:00100000:3.0:1790100452.197229:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109485696 00010000:00010000:3.0:1790100452.197278:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e6a expref: 51 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.197356:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:3.0:1790100452.197367:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:2358:x1877056109485696:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100452.197387:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100452.197396:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e6a expref: 51 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.197409:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e6a expref: 51 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.197451:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefd9f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e6a expref: 51 pid: 6711 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.197475:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:3.0:1790100452.197481:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.197492:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.197500:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.197542:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100452.197645:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:2358:x1877056109485696:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 278us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.197653:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00010000:00010000:0.0:1790100452.197776:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.197785:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100452.197865:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790100452.197871:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100452.197897:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.197933:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefda0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e71 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.197962:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e71 expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.197971:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:0.0:1790100452.197974:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100452.197977:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142c00, rc 0) 00000100:00100000:0.0:1790100452.198007:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+49:11492:x1877056109485568:12345-192.168.201.18@tcp:101:bash.0 Request processed in 4443us (4808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100452.198015:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 161 00000100:00100000:0.0:1790100452.201535:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.201670:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109485952 00000100:00100000:1.0:1790100452.201682:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109485952 00000100:00100000:1.0:1790100452.201758:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1790100452.201771:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+49:11492:x1877056109485952:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:1.0:1790100452.202106:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:11492:x1877056109485952:12345-192.168.201.18@tcp:35:bash.0 Request processed in 337us (583us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1790100452.202114:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1790100452.270991:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100452.271129:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109486208 00000100:00100000:2.0:1790100452.271142:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109486208 00000100:00100000:2.0:1790100452.271231:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 162 00000100:00100000:2.0:1790100452.271244:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:11502:x1877056109486208:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100452.271279:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100452.271305:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e78 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100452.271421:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790100452.271577:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e78 expref: 52 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.271590:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:2.0:1790100452.271593:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100452.271596:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e78 expref: 52 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.271661:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143800, rc 0) 00000100:00100000:2.0:1790100452.271738:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:11502:x1877056109486208:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 496us (761us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1790100452.271746:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 162 00000100:00100000:0.0:1790100452.275363:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.275588:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109486336 00000100:00100000:3.0:1790100452.277006:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109486336 00000100:00100000:3.0:1790100452.277103:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:3.0:1790100452.277116:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:11502:x1877056109486336:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:3.0:1790100452.277230:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277252:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277267:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277285:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277291:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277298:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277409:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277418:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277425:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790100452.277476:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277508:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277515:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277522:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277528:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100452.277532:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277540:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277553:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100452.277556:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100452.277561:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277567:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefda2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277582:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277588:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277594:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277604:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100452.277607:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277645:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277654:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787ec1d00) 00010000:00010000:3.0:1790100452.277657:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100452.277660:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277666:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277685:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277704:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277711:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277716:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aea00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100452.277719:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.277725:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.278016:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:3.0:1790100452.278019:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100452.278023:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.278029:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.278133:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:11502:x1877056109486336:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 1018us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.278142:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:0.0:1790100452.284684:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.284987:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109486592 00000100:00100000:1.0:1790100452.285001:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109486592 00000100:00100000:1.0:1790100452.285076:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:1.0:1790100452.285089:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:11502:x1877056109486592:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1790100452.285405:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:11502:x1877056109486592:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 318us (736us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1790100452.285413:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:1.0:1790100452.335672:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100452.335850:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109486848 00000100:00100000:0.0:1790100452.335863:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109486848 00000100:00100000:0.0:1790100452.335953:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:0.0:1790100452.335965:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b16b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:11505:x1877056109486848:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100452.336000:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100452.336028:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefda3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e7f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336131:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336149:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336163:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336294:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336304:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336312:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336469:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefda54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336502:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefda54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336511:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefda54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100452.336525:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790100452.336716:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336725:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336733:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336964:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100452.336970:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336979:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.336995:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:0.0:1790100452.336999:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100452.337005:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337013:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefda46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337029:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337043:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337049:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337054:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100452.337058:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337064:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337073:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787edf600) 00010000:00010000:0.0:1790100452.337076:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100452.337079:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337084:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefda4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337140:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefda3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e7f expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337156:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefda54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e7f expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.337164:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:0.0:1790100452.337166:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100452.337292:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819800, rc 0) 00000100:00100000:0.0:1790100452.337383:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b16b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:11505:x1877056109486848:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1420us (1773us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1790100452.337393:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 164 00000100:00100000:0.0:1790100452.340253:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.340403:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109487104 00000100:00100000:1.0:1790100452.340415:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109487104 00000100:00100000:1.0:1790100452.340493:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:1.0:1790100452.340506:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:11505:x1877056109487104:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:1.0:1790100452.340590:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.340639:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.340657:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.340700:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.340708:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.340715:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.340723:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100452.340728:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.340744:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.340758:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100452.340761:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100452.340785:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.340792:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12400/0x31a8f3fdeeefda62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100452.340884:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:11505:x1877056109487104:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 380us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.340892:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 165 00000100:00100000:3.0:1790100452.342780:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100452.343002:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109486976 00000100:00100000:0.0:1790100452.343015:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109486976 00000100:00100000:0.0:1790100452.343092:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1790100452.343104:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:2359:x1877056109486976:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100452.343123:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100452.343150:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefda54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e7f expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.343184:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:0.0:1790100452.343190:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100452.343252:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:2359:x1877056109486976:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 150us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100452.343259:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1790100452.344707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.344765:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109487360 00000100:00100000:3.0:1790100452.344775:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109487360 00000100:00100000:3.0:1790100452.344824:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:3.0:1790100452.344836:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+53:11505:x1877056109487360:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100452.345162:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:11505:x1877056109487360:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 327us (464us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1790100452.345171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:1.0:1790100452.473894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.474013:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109487616 00000100:00100000:3.0:1790100452.474027:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109487616 00000100:00100000:3.0:1790100452.474102:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:3.0:1790100452.474114:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b16aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:11524:x1877056109487616:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1790100452.474148:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100452.474182:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e86 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.474337:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.474354:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.474372:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100452.474388:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790100452.474555:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefda69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e86 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.474578:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e86 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.474588:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:3.0:1790100452.474591:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790100452.474595:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af400, rc 0) 00000100:00100000:3.0:1790100452.474730:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b16aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:11524:x1877056109487616:12345-192.168.201.18@tcp:101:cat.0 Request processed in 617us (849us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1790100452.474737:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 166 00000100:00100000:0.0:1790100452.495498:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100452.495641:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109487744 00000100:00100000:2.0:1790100452.495654:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109487744 00000100:00100000:2.0:1790100452.495724:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:2.0:1790100452.495735:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:11525:x1877056109487744:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100452.495766:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100452.495791:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e8d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.495874:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefda85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.495897:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefda85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.495910:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefda85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100452.495987:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790100452.495991:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100452.496011:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefda85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.496042:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e8d expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.496063:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefda85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e8d expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.496073:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:2.0:1790100452.496076:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100452.496080:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142a00, rc 0) 00000100:00100000:2.0:1790100452.496158:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11525:x1877056109487744:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 424us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.496165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 167 00000100:00100000:0.0:1790100452.505700:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.505831:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109488128 00000100:00100000:3.0:1790100452.505852:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109488128 00000100:00100000:3.0:1790100452.505959:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:3.0:1790100452.505978:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11525:x1877056109488128:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100452.506570:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:11525:x1877056109488128:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 599us (886us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1790100452.506588:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:1.0:1790100452.516799:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.520566:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109488256 00000100:00100000:3.0:1790100452.520590:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109488256 00000100:00100000:3.0:1790100452.520791:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:3.0:1790100452.520804:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:11525:x1877056109488256:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:3.0:1790100452.520827:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790100452.520859:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefda15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e71 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.520891:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefda70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e86 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.520906:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefd920 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e32 expref: 56 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.520918:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:3.0:1790100452.520932:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100452.521020:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b168380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:11525:x1877056109488256:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 218us (4236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.521028:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:1.0:1790100452.532538:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100452.532744:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109488384 00000100:00100000:2.0:1790100452.532757:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109488384 00000100:00100000:2.0:1790100452.532845:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:2.0:1790100452.532858:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:11525:x1877056109488384:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:2.0:1790100452.533071:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.533094:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.533109:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100452.533772:0:11548:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1790100452.533883:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:11525:x1877056109488384:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 1024us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.533893:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 168 00000100:00100000:0.0:1790100452.559201:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100452.559344:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109488512 00000100:00100000:2.0:1790100452.559358:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109488512 00000100:00100000:2.0:1790100452.559437:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 169 00000100:00100000:2.0:1790100452.559450:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:11527:x1877056109488512:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100452.559478:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100452.559504:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefda93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e94 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559590:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559607:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559658:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559674:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559682:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559689:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559838:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559848:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559855:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100452.559898:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790100452.559904:0:6711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100452.559928:0:6711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559952:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559962:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559968:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559976:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559983:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100452.559988:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.559997:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560016:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:2.0:1790100452.560019:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100452.560024:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560030:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefda9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560045:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560051:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560056:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560061:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100452.560064:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560070:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560078:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787def400) 00010000:00010000:2.0:1790100452.560080:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100452.560083:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560088:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdaa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560132:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefda93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e94 expref: 57 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560148:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e94 expref: 56 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100452.560156:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:2.0:1790100452.560157:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100452.560160:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143e00, rc 0) 00000100:00100000:2.0:1790100452.560237:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:11527:x1877056109488512:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 789us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100452.560245:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 169 00010000:00010000:1.0:1790100452.709761:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100452.777277:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100452.777289:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790100452.777357:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1790100452.777369:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790100452.777528:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5d5c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126259456:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790100452.777670:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fd7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100452.783985:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.784204:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109488640 00000100:00100000:1.0:1790100452.784216:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109488640 00000100:00100000:1.0:1790100452.784294:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:1.0:1790100452.784307:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11538:x1877056109488640:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790100452.784351:0:5842:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790100452.784486:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11538:x1877056109488640:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 182us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.784494:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 170 00000100:00100000:3.0:1790100452.785002:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5d5c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126259456:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790100452.788038:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.788723:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109488768 00000100:00100000:1.0:1790100452.788737:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109488768 00000100:00100000:1.0:1790100452.788827:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:1.0:1790100452.788840:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:11538:x1877056109488768:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790100452.788952:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.788974:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789002:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789021:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789029:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789037:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789071:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789079:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789086:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100452.789134:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790100452.789140:0:11548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100452.789156:0:11548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789168:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789176:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789193:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789200:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100452.789205:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789214:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789227:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:1.0:1790100452.789231:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.789236:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789243:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdaaf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789261:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789267:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789273:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789279:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100452.789282:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789298:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789306:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d6799df4100) 00010000:00010000:1.0:1790100452.789308:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.789311:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789316:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefdab6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789333:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789338:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789343:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789349:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100452.789352:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789358:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789366:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:1.0:1790100452.789369:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.789372:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.789391:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdabd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100452.789481:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:11538:x1877056109488768:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 642us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.789490:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 171 00000100:00100000:1.0:1790100452.792842:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100452.792952:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109489024 00000100:00100000:0.0:1790100452.792965:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109489024 00000100:00100000:0.0:1790100452.793306:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:0.0:1790100452.793320:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:11538:x1877056109489024:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100452.793359:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100452.793385:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdac4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64e9b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793511:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793530:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793544:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100452.793557:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790100452.793724:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793732:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793738:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793744:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100452.793749:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793757:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793770:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:0.0:1790100452.793779:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100452.793785:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793792:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdacb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793839:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdac4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e9b expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793850:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:0.0:1790100452.793852:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790100452.793856:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdac4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e9b expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.793865:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818a00, rc 0) 00000100:00100000:0.0:1790100452.793957:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11538:x1877056109489024:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 641us (1131us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1790100452.793965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 172 00000100:00100000:0.0:1790100452.797467:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.797910:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109489152 00000100:00100000:3.0:1790100452.797964:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109489152 00000100:00100000:3.0:1790100452.798534:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:3.0:1790100452.798560:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11538:x1877056109489152:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790100452.798670:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790100452.798829:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11538:x1877056109489152:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 284us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.798837:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 173 00000100:00100000:1.0:1790100452.804462:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.804551:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109489408 00000100:00100000:3.0:1790100452.804564:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109489408 00000100:00100000:3.0:1790100452.804662:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 174 00000100:00100000:3.0:1790100452.804675:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11538:x1877056109489408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100452.804704:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100452.804708:0:11548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790100452.804752:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142a00/0x31a8f3fdeeefda85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e8d expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.804775:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100452.804781:0:11548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100452.804798:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdad9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ea2 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100452.805512:0:11548:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790100452.805822:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.805862:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.805874:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.805957:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdad9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea2 expref: 59 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.805976:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea2 expref: 58 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.806517:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787ec1400) 00010000:00010000:3.0:1790100452.806521:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100452.806525:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900aea00, rc 0) 00000100:00100000:3.0:1790100452.806672:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:11538:x1877056109489408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1997us (2223us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1790100452.806682:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 174 00000100:00100000:1.0:1790100452.811371:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100452.811475:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109489664 00000100:00100000:0.0:1790100452.811490:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109489664 00000100:00100000:0.0:1790100452.811595:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 175 00000100:00100000:0.0:1790100452.811649:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:11538:x1877056109489664:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100452.811730:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100452.811889:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea2 expref: 58 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.811926:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787ec1400) 00010000:00010000:0.0:1790100452.811949:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100452.811979:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.812006:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.812018:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824258:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824290:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824307:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824404:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824413:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824420:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824427:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100452.824434:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824465:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824480:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:1.0:1790100452.824484:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.824490:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824496:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdaee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824512:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824518:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824524:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824530:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100452.824533:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824539:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824546:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4ca9b42e (ffff8d6799df4100) 00010000:00010000:1.0:1790100452.824550:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100452.824553:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.824570:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdaf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4ca9b42e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100452.824769:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11538:x1877056109489664:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 13155us (13405us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790100452.824780:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 175 00000100:00100000:3.0:1790100452.827261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100452.827831:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109489792 00000100:00100000:0.0:1790100452.827848:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109489792 00000100:00100000:0.0:1790100452.827927:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 176 00000100:00100000:0.0:1790100452.827946:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11538:x1877056109489792:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100452.827971:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100452.827995:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdafc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ea9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.828036:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.828056:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.828074:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.828206:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdafc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea9 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.828234:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea9 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.828244:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:0.0:1790100452.828248:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790100452.828252:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818600, rc 0) 00000100:00100000:0.0:1790100452.828335:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:11538:x1877056109489792:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 391us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100452.828342:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 176 00000100:00100000:3.0:1790100452.830860:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.831493:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109490048 00000100:00100000:1.0:1790100452.831505:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109490048 00000100:00100000:1.0:1790100452.831594:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 177 00000100:00100000:1.0:1790100452.831654:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:11538:x1877056109490048:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790100452.831763:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.831785:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.831798:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100452.832413:0:11548:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1790100452.832427:0:11548:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349401815293ns, next at 350401812163ns, rc = 0 00000004:00010000:1.0:1790100452.832539:0:11548:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9f45676 reply state 00000000a4d0be60 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100452.832550:0:11548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790100452.832960:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:11538:x1877056109490048:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1351us (2111us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1790100452.832969:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 177 00010000:00010000:0.0:1790100452.835325:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.835343:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.835351:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.835357:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100452.835362:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.835371:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.835389:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:0.0:1790100452.835393:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790100452.835398:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100452.835421:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdb0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100452.835556:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.836862:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109490176 00000100:00100000:1.0:1790100452.836878:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109490176 00000100:00100000:1.0:1790100452.836963:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 178 00000100:00100000:1.0:1790100452.836975:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:11538:x1877056109490176:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100452.837016:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100452.837040:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64eb0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.837113:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb0 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.837129:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb0 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.837151:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:1.0:1790100452.837154:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100452.837159:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13000, rc 0) 00000100:00100000:1.0:1790100452.837574:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:11538:x1877056109490176:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 600us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.837582:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 178 00000100:00100000:2.0:1790100452.915376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.915452:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109490304 00000100:00100000:3.0:1790100452.915465:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109490304 00000100:00100000:3.0:1790100452.915570:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:3.0:1790100452.915590:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109490304:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790100452.916410:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109490304:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 819us (1044us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1790100452.916440:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00080000:1.0:1790100452.916525:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100452.925471:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.925556:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109490560 00000100:00100000:3.0:1790100452.925569:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109490560 00000100:00100000:3.0:1790100452.925660:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:3.0:1790100452.925672:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:11538:x1877056109490560:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790100452.925965:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11538:x1877056109490560:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 295us (505us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1790100452.925973:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:2.0:1790100452.927873:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.927949:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109490816 00000100:00100000:3.0:1790100452.927958:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109490816 00000100:00100000:3.0:1790100452.928040:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 179 00000100:00100000:3.0:1790100452.928051:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11538:x1877056109490816:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790100452.928179:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11538:x1877056109490816:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 129us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.928186:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 179 00000100:00100000:1.0:1790100452.940119:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100452.940210:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109490944 00000100:00100000:3.0:1790100452.940226:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109490944 00000100:00100000:3.0:1790100452.940313:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 180 00000100:00100000:3.0:1790100452.940326:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11538:x1877056109490944:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100452.940355:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100452.940381:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdb18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64eb7 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.940499:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdb1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.940525:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdb1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.940538:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdb1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100452.940581:0:11548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100452.940603:0:11548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdb1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.940656:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdb18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb7 expref: 63 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.940677:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdb1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb7 expref: 62 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.940687:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:3.0:1790100452.940691:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790100452.940694:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af800, rc 0) 00000100:00100000:3.0:1790100452.940881:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11538:x1877056109490944:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 557us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.940888:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 180 00000100:00100000:2.0:1790100452.944788:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.944901:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109491072 00000100:00100000:1.0:1790100452.944912:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109491072 00000100:00100000:1.0:1790100452.945048:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:1.0:1790100452.945118:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109491072:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100452.945142:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100452.945235:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ebe expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100452.945269:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c3e4, blocks: 0x1 00010000:00010000:1.0:1790100452.945296:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1790100452.945301:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100452.945313:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ebe expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.945332:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ebe expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.945348:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12e00, rc 0) 00000100:00100000:1.0:1790100452.945489:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109491072:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 375us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.945496:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:3.0:1790100452.955281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.955362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109491328 00000100:00100000:1.0:1790100452.955375:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109491328 00000100:00100000:1.0:1790100452.955436:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 181 00000100:00100000:1.0:1790100452.955445:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11538:x1877056109491328:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790100452.972594:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11538:x1877056109491328:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 17117us (17294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100452.972625:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 181 00000100:00100000:1.0:1790100452.978185:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100452.978233:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109491456 00000100:00100000:1.0:1790100452.978246:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109491456 00000100:00100000:1.0:1790100452.978325:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:1.0:1790100452.978337:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:11538:x1877056109491456:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100452.978360:0:12004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100452.978383:0:12004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ec5 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.978419:0:12004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ebe expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.978430:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100452.978435:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100452.978441:0:12004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 9 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.978476:0:12004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ebe expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100452.978491:0:12004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ebe expref: 9 pid: 6690 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100452.978507:0:12004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a81880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12004:1877056126259584:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100452.978896:0:12004:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fe79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100452.999272:0:12004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a81880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12004:1877056126259584:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100452.999317:0:12004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 9 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100452.999361:0:12004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12600, rc 0) 00000100:00100000:3.0:1790100452.999447:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:11538:x1877056109491456:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 21112us (21283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100452.999457:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:0.0:1790100453.019729:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100453.026311:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109491584 00000100:00100000:3.0:1790100453.026334:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109491584 00010000:00010000:3.0:1790100453.026417:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ebe expref: 9 pid: 6690 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.026648:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:3.0:1790100453.026659:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2357:x1877056109491584:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100453.026681:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100453.026711:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ebe expref: 9 pid: 6690 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026728:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ebe expref: 9 pid: 6690 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026772:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003efdd050/0x31a8f3fdeeefdb26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ebe expref: 9 pid: 6690 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026796:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100453.026801:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100453.026811:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026839:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.026890:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.026906:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1877056126259712:192.168.201.18@tcp:105: 00000100:00100000:3.0:1790100453.029335:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fd7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100453.034497:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100453.034556:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1877056126259712:192.168.201.18@tcp:105: 00010000:00010000:2.0:1790100453.034586:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100453.034663:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109491584:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 8005us (14946us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100453.034675:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:3.0:1790100453.040750:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109491712 00000100:00100000:3.0:1790100453.040768:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109491712 00002000:00100000:3.0:1790100453.040837:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d67876a3480 x1877056109491712/t0(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:749/0 lens 504/0 e 0 to 0 dl 1790100464 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790100453.040852:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67876a3480 with x1877056109491712 ext(0->8) 00002000:00010000:3.0:1790100453.040859:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67876a3480 00000100:00100000:3.0:1790100453.040897:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1790100453.040906:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109491712:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790100453.046123:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:2357:x1877056109491712:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 4567us (10988us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1790100453.046137:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00002000:00100000:3.0:1790100453.046151:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d67876a3480 x1877056109491712/t4294967314(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:749/0 lens 504/448 e 0 to 0 dl 1790100464 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790100453.046161:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67876a3480 with x1877056109491712 ext(0->8) 00002000:00010000:3.0:1790100453.046168:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67876a3480 00000100:00100000:2.0:1790100453.049018:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100453.049076:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109491840 00000100:00100000:3.0:1790100453.049091:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109491840 00000100:00100000:3.0:1790100453.049198:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 182 00000100:00100000:3.0:1790100453.049206:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11538:x1877056109491840:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1790100453.259883:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11538:x1877056109491840:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 210665us (210866us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.259897:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 182 00000001:00080000:3.0:1790100453.259947:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:3.0:1790100453.259962:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1790100453.259966:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1790100453.259999:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d67bf818f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1790100453.260004:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ae5fdd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d67bf818a80 00000020:00080000:3.0:1790100453.260007:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ae5fdb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d67bf3cfc00 00000004:00080000:3.0:1790100453.260030:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1790100453.260040:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1790100453.260066:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1790100453.261496:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1790100453.261709:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790100453.261916:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126259840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790100453.262001:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100453.263628:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126259840 00000100:00100000:1.0:1790100453.263643:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126259840 00000100:00100000:1.0:1790100453.263724:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790100453.263735:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126259840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790100453.263958:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790100453.263963:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790100452 00002000:00010000:1.0:1790100453.263965:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790100453.263967:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790100452 -> 1790100452 00002000:00010000:1.0:1790100453.263970:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790100453.264045:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126259840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (2043us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1790100453.264069:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:1.0:1790100453.264124:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67ad19b480/2, rc 0, transno 4294967315 00000100:00100000:1.0:1790100453.264131:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad19b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126259840:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1790100453.265154:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100453.270327:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126259968:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790100453.270419:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100453.279443:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126259968 00000100:00100000:0.0:1790100453.279459:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126259968 00000100:00100000:0.0:1790100453.279533:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790100453.279542:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1877056126259968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790100453.279573:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1790100453.279630:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ab2c3e1, atime: 0x6ab2c3e1, ctime: 0x6ab2c3e1, blocks: 0x1 00010000:00010000:0.0:1790100453.279639:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.279657:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1790100453.279662:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100453.279668:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.279684:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.279694:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.279719:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.279737:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1790100453.281410:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100453.282533:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1877056126259968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2985us (12107us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790100453.282546:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:0.0:1790100453.282648:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100453.282655:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.282667:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100453.282672:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.282685:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.282706:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.282715:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d93ca9/0x31a8f3fdeeefdb34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.282747:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100453.282761:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100453.282763:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790100453.283381:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67bf3fd180/2, rc 0, transno 4294967307 00000100:00100000:1.0:1790100453.283390:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126259968:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790100453.284120:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100453.284202:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109491968 00000100:00100000:1.0:1790100453.284212:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109491968 00000100:00100000:1.0:1790100453.284264:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:1.0:1790100453.284274:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:2358:x1877056109491968:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1790100453.415406:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1790100453.415426:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1790100453.419430:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109491968:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 135146us (135302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100453.419445:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:3.0:1790100453.426406:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100453.426509:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109492224 00000100:00100000:0.0:1790100453.426520:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109492224 00000100:00100000:0.0:1790100453.426576:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 183 00000100:00100000:0.0:1790100453.426587:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:11538:x1877056109492224:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100453.426709:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100453.426936:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdb1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb7 expref: 18 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.426958:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:0.0:1790100453.426964:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100453.426996:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.427010:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.427019:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100453.427535:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000491ef7da reply state 000000008edbd79a transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.427545:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100453.428352:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:11538:x1877056109492224:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1763us (1953us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1790100453.428376:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 183 00010000:00010000:0.0:1790100453.432511:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.432529:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.432537:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.432543:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100453.432547:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.432554:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.432574:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:0.0:1790100453.432577:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100453.432582:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.432588:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdb3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.435259:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100453.435295:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109492352 00000100:00100000:0.0:1790100453.435305:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109492352 00000100:00100000:0.0:1790100453.435355:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:0.0:1790100453.435366:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109492352:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790100453.435658:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790100453.435662:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790100452 -> 1790100451 00002000:00010000:0.0:1790100453.435665:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790100449 00002000:00010000:0.0:1790100453.435667:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790100452 -> 1790100451 00002000:00010000:0.0:1790100453.435669:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790100453.435746:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109492352:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 359us (474us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1790100453.435754:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:3.0:1790100453.450150:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100453.454017:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109492608 00000100:00100000:0.0:1790100453.454033:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109492608 00000100:00100000:0.0:1790100453.455410:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 184 00000100:00100000:0.0:1790100453.455428:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:11538:x1877056109492608:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790100453.455506:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.455525:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.455535:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.455574:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.455589:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea9 expref: 18 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.455637:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126260096:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100453.455724:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100453.460636:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1877056126260096:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100453.460667:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.462487:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100453.462566:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109492736 00000100:00100000:0.0:1790100453.462576:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109492736 00010000:00010000:0.0:1790100453.462647:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea9 expref: 19 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.462685:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:0.0:1790100453.462696:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad539500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:2357:x1877056109492736:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100453.462711:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100453.462718:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea9 expref: 19 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.462751:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea9 expref: 19 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.462774:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ea9 expref: 19 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463012:0:12013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:0.0:1790100453.463018:0:12013:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463041:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463049:0:12013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463087:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100453.463141:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad539500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:2357:x1877056109492736:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 446us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100453.463148:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00010000:00010000:0.0:1790100453.463247:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463256:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463284:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463291:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463298:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463305:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100453.463309:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463318:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463333:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:0.0:1790100453.463336:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790100453.463340:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.463347:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.463492:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:11538:x1877056109492608:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 8069us (13349us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790100453.463501:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 184 00000100:00100000:3.0:1790100453.469670:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100453.469802:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109492864 00000100:00100000:0.0:1790100453.469813:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109492864 00000100:00100000:0.0:1790100453.469864:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:0.0:1790100453.469875:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109492864:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790100453.469934:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.469955:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.469964:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790100453.469969:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790100453.469974:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.470011:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 8 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.470033:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 8 pid: 12004 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.470062:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877056126260224:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100453.473035:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100453.481473:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877056126260224:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100453.481509:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100453.490198:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100453.490303:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109492992 00000100:00100000:3.0:1790100453.490315:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109492992 00010000:00010000:3.0:1790100453.490360:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 9 pid: 12004 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.490429:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:3.0:1790100453.490440:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2357:x1877056109492992:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100453.490456:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100453.490479:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 9 pid: 12004 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.490493:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 9 pid: 12004 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.490707:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000813cbb56/0x31a8f3fdeeefdb2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ec5 expref: 9 pid: 12004 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.490725:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100453.490730:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100453.490736:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.490746:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.490778:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100453.490835:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109492992:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 396us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.490849:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00010000:00010000:1.0:1790100453.490929:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.490940:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.490967:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.490986:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.490995:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.491002:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819c00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100453.491007:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.491016:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.491029:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.491037:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002333ac85/0x31a8f3fdeeefdb49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100453.491082:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2357:x1877056109492864:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 21209us (21422us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100453.491090:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:2.0:1790100453.514711:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100453.514819:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109493248 00000100:00100000:0.0:1790100453.514830:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109493248 00000100:00100000:0.0:1790100453.514881:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 185 00000100:00100000:0.0:1790100453.514891:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+17:11538:x1877056109493248:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790100453.514987:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.515006:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.515018:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.515233:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.515244:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb0 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.515262:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.515300:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb0 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100453.515314:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb0 expref: 18 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100453.515329:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126260352:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100453.515403:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100453.521496:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126260352:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100453.521546:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.536528:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100453.536568:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109493376 00000100:00100000:3.0:1790100453.536592:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109493376 00010000:00010000:3.0:1790100453.536650:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb0 expref: 19 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.536691:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:3.0:1790100453.536701:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:2357:x1877056109493376:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100453.536717:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100453.536724:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb0 expref: 19 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.536738:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb0 expref: 19 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.536762:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdb11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eb0 expref: 19 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.537231:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:3.0:1790100453.537237:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.537262:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.537272:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.537301:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100453.537358:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:2357:x1877056109493376:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 657us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100453.537366:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00010000:00010000:3.0:1790100453.537475:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.537483:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100453.540375:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1790100453.542117:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1790100453.542202:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1790100453.542296:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad538700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1877056126260480:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790100453.542363:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100453.542574:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2633480 going to sleep for 11 seconds 00000100:00100000:0.0:1790100453.554803:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126260480 00000100:00100000:0.0:1790100453.554820:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126260480 00000100:00100000:0.0:1790100453.554892:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100453.554903:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1877056126260480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790100453.555190:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1877056126260480:12345-0@lo:1000:mdt00_001.0 Request processed in 288us (12826us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100453.555199:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100453.562959:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1790100453.562981:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67ad19b480, transno 4294967315 00000100:00100000:2.0:1790100453.563005:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad538700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1877056126260480:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790100453.564215:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1790100453.564295:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1877056126260608:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790100453.564358:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100453.564862:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2758540 going to sleep for 11 seconds 00000100:00100000:1.0:1790100453.569724:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126260608 00000100:00100000:1.0:1790100453.569741:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126260608 00000100:00100000:3.0:1790100453.569880:0:12069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100453.569895:0:12069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5842:x1877056126260608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790100453.570193:0:12069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5842:x1877056126260608:12345-0@lo:1000:mdt00_001.0 Request processed in 301us (5834us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1790100453.570202:0:12069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100453.570235:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1877056126260608:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1790100453.570286:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570297:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570305:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570312:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100453.570317:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570325:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570343:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787edf600) 00010000:00010000:1.0:1790100453.570346:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100453.570351:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570358:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdb57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570388:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570394:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570400:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570414:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100453.570417:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570423:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570430:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:1.0:1790100453.570433:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100453.570436:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570441:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefda8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570472:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e94 expref: 21 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.570481:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.571723:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e94 expref: 21 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.571747:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e94 expref: 21 pid: 6711 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100453.571848:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a81500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126260736:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100453.571953:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67901a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1790100453.581092:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a81500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126260736:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100453.581125:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100453.584877:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100453.584979:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109493504 00000100:00100000:2.0:1790100453.584990:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109493504 00010000:00010000:2.0:1790100453.585033:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e94 expref: 22 pid: 6711 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100453.585074:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:2.0:1790100453.585084:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad537480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:2358:x1877056109493504:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100453.585098:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100453.585106:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e94 expref: 22 pid: 6711 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.585120:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e94 expref: 22 pid: 6711 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.585142:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefdaa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64e94 expref: 22 pid: 6711 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.585157:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:2.0:1790100453.585163:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.585173:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.585190:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100453.585227:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100453.585292:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad537480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:2358:x1877056109493504:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 209us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100453.585300:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00010000:00010000:1.0:1790100453.585970:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.585981:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.585993:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586000:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586007:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586013:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100453.586017:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586024:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586034:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:1.0:1790100453.586046:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100453.586051:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586059:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdb5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586072:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586078:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586084:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586090:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100453.586093:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586099:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586106:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:1.0:1790100453.586109:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790100453.586112:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.586119:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdb50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100453.587878:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100453.587885:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100453.588478:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1790100453.588485:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100453.589128:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:11538:x1877056109493248:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 74231us (74419us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1790100453.589141:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 185 00000020:00080000:0.0:1790100453.589148:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1790100453.596189:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100453.598062:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109493760 00000100:00100000:1.0:1790100453.598079:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109493760 00000100:00100000:3.0:1790100453.598354:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:3.0:1790100453.598365:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67a93f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:11538:x1877056109493760:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790100453.599563:0:5845:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790100453.599711:0:5845:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1790100453.600301:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.600322:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.600335:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.600345:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.600361:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.600368:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100453.600390:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100453.600444:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100453.600454:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.600464:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100453.600468:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.600479:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.600494:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d6787ec1100) 00010000:00010000:1.0:1790100453.600498:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1790100453.600504:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67a93f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:11538:x1877056109493760:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 2135us (4326us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1790100453.600514:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000020:00080000:3.0:1790100453.600521:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790100453.600720:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.600729:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdb65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100453.600749:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100453.600751:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100453.600754:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100453.734038:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100453.758857:0:12519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100453.758867:0:12519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100453.758903:0:12519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1790100453.758908:0:12519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790100454.005749:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.006900:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109494016 00000100:00100000:0.0:1790100454.006940:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109494016 00000100:00100000:0.0:1790100454.007077:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 186 00000100:00100000:0.0:1790100454.007089:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:11548:x1877056109494016:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100454.007131:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100454.007165:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdb6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ecc expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.007270:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdb73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.007286:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdb73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.007299:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdb73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100454.007312:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790100454.007439:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdb6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ecc expref: 25 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.007458:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdb73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ecc expref: 24 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.007467:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:0.0:1790100454.007470:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790100454.007474:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818400, rc 0) 00000100:00100000:0.0:1790100454.009148:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:11548:x1877056109494016:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2052us (3398us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1790100454.009160:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 186 00000100:00080000:1.0:1790100454.009344:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100454.013659:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.013972:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109494144 00000100:00100000:2.0:1790100454.013984:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109494144 00000100:00100000:2.0:1790100454.014047:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 187 00000100:00100000:2.0:1790100454.014059:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:11548:x1877056109494144:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:2.0:1790100454.014137:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014157:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014169:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014185:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014207:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014214:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014451:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014460:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014467:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100454.014506:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014519:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014527:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014535:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014541:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100454.014545:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014553:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014571:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:2.0:1790100454.014575:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100454.014580:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014586:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdb81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014598:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014604:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014640:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014646:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100454.014649:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014656:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014663:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787def400) 00010000:00010000:2.0:1790100454.014666:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100454.014669:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014675:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143200/0x31a8f3fdeeefdb88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014700:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014706:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014712:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014717:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100454.014720:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014725:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014732:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787defd00) 00010000:00010000:2.0:1790100454.014735:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100454.014737:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.014742:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefdb8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100454.014828:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:11548:x1877056109494144:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 771us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100454.014836:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 187 00000100:00100000:2.0:1790100454.112122:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.112746:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109494400 00000100:00100000:0.0:1790100454.112760:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109494400 00000100:00100000:0.0:1790100454.112901:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 188 00000100:00100000:0.0:1790100454.112940:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:11551:x1877056109494400:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100454.112963:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100454.112985:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdb96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ed3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113066:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113081:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113094:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113109:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113116:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113122:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113540:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113550:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113558:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100454.113579:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790100454.113710:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113720:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113727:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113734:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100454.113739:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113747:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113761:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:0.0:1790100454.113763:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100454.113769:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113776:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdb9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113787:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113794:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113827:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113833:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100454.113836:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113843:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113851:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787edff00) 00010000:00010000:0.0:1790100454.113854:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100454.113857:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113863:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.113904:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdb96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ed3 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.115084:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ed3 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.115094:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:0.0:1790100454.115096:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100454.115099:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818200, rc 0) 00000100:00100000:0.0:1790100454.115199:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:11551:x1877056109494400:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2287us (3085us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1790100454.115222:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 188 00000100:00100000:0.0:1790100454.125064:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.125214:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109494528 00000100:00100000:0.0:1790100454.125227:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109494528 00000100:00100000:0.0:1790100454.125288:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 189 00000100:00100000:0.0:1790100454.125298:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:11551:x1877056109494528:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:0.0:1790100454.125367:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.125389:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.125402:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.125427:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.125435:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.125442:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.125448:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100454.125453:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.125460:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.125492:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:0.0:1790100454.125496:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790100454.125501:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.125508:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdbb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100454.125583:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:11551:x1877056109494528:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 285us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100454.125590:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 189 00000100:00100000:2.0:1790100454.143667:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100454.144985:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109494784 00000100:00100000:3.0:1790100454.145014:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109494784 00000100:00100000:3.0:1790100454.145088:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:3.0:1790100454.145098:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:11551:x1877056109494784:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100454.150389:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:11551:x1877056109494784:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 5279us (6719us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1790100454.150405:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000001:00080000:2.0:1790100454.214732:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1790100454.214776:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1790100454.227369:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.235161:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109495040 00000100:00100000:0.0:1790100454.235597:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109495040 00000100:00100000:1.0:1790100454.235785:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 190 00000100:00100000:1.0:1790100454.235798:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:11084:x1877056109495040:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1790100454.235831:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100454.235869:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64eda expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.236000:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.236033:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ed3 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.236057:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.236100:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ed3 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.236115:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ed3 expref: 28 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100454.236129:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1877056126260864:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100454.236604:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7480 going to sleep for 11 seconds 00000100:00100000:1.0:1790100454.240117:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1877056126260864:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100454.240473:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100454.247419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.247776:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109495168 00000100:00100000:0.0:1790100454.247789:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109495168 00010000:00010000:0.0:1790100454.247836:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ed3 expref: 29 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100454.247893:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:0.0:1790100454.247904:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:2358:x1877056109495168:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100454.247930:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100454.247938:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ed3 expref: 29 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.247953:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ed3 expref: 29 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.247976:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ed3 expref: 29 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.248008:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:0.0:1790100454.248013:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.248024:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.248032:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.248068:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100454.248127:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:2358:x1877056109495168:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 225us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100454.248135:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00010000:00010000:1.0:1790100454.248817:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.248825:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100454.248843:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1790100454.249136:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eda expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.249255:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eda expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.249263:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:1.0:1790100454.249266:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790100454.249269:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13a00, rc 0) 00000100:00100000:1.0:1790100454.249320:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:11084:x1877056109495040:12345-192.168.201.18@tcp:101:bash.0 Request processed in 13524us (21961us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1790100454.249329:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 190 00000100:00100000:3.0:1790100454.277339:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.277649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109495424 00000100:00100000:0.0:1790100454.277659:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109495424 00000100:00100000:0.0:1790100454.277781:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 191 00000100:00100000:0.0:1790100454.277793:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:11084:x1877056109495424:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:0.0:1790100454.278095:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.278114:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.278127:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100454.281093:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1790100454.281590:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d809746 reply state 0000000094c66d83 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100454.281605:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790100454.281949:0:5842:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1790100454.282235:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:11084:x1877056109495424:12345-192.168.201.18@tcp:36:bash.0 Request processed in 4439us (4900us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1790100454.282244:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 191 00000020:00080000:3.0:1790100454.282251:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1790100454.296940:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.296958:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.296967:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.296974:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100454.296979:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.296986:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.297005:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:1.0:1790100454.297009:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100454.297014:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.297048:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdbd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100454.297850:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.297979:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109495552 00000100:00100000:2.0:1790100454.297990:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109495552 00000100:00100000:2.0:1790100454.298060:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 192 00000100:00100000:2.0:1790100454.298071:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:11084:x1877056109495552:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1790100454.298094:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100454.298115:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdbdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ee1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.298328:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdbdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee1 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.298346:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdbdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee1 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.298367:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:2.0:1790100454.298371:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100454.298374:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143000, rc 0) 00000100:00100000:2.0:1790100454.298452:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:11084:x1877056109495552:12345-192.168.201.18@tcp:101:bash.0 Request processed in 383us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100454.298459:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 192 00000100:00100000:0.0:1790100454.306554:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.306804:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109495680 00000100:00100000:2.0:1790100454.306816:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109495680 00000100:00100000:2.0:1790100454.306897:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:2.0:1790100454.306919:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:11084:x1877056109495680:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1790100454.306937:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100454.306959:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ee8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790100454.307000:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ab2c3e3, atime: 0x6ab2c3e1, ctime: 0x6ab2c3e3, blocks: 0xb 00010000:00010000:2.0:1790100454.307026:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1790100454.307032:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100454.307041:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee8 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.307058:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee8 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.307072:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142000, rc 0) 00000100:00100000:2.0:1790100454.307141:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:11084:x1877056109495680:12345-192.168.201.18@tcp:101:bash.0 Request processed in 235us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100454.307149:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00080000:1.0:1790100454.307466:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100454.311234:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.311356:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109495808 00000100:00100000:2.0:1790100454.311367:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109495808 00002000:00010000:2.0:1790100454.311413:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1790100454.311418:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf3fc380 with x1877056109495808 ext(0->18446744073709551615) 00002000:00010000:2.0:1790100454.311431:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bf3fc380. 00000100:00100000:2.0:1790100454.311522:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:2.0:1790100454.311533:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109495808:12345-192.168.201.18@tcp:10:bash.0 00002000:00010000:2.0:1790100454.311883:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790100454.311887:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790100451 -> 1790100453 00002000:00010000:2.0:1790100454.311890:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1790100449 -> 1790100449 00002000:00010000:2.0:1790100454.311892:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790100451 -> 1790100453 00002000:00010000:2.0:1790100454.311902:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790100454.311989:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2357:x1877056109495808:12345-192.168.201.18@tcp:10:bash.0 Request processed in 457us (763us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1790100454.311997:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00002000:00010000:2.0:1790100454.312001:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1790100454.312004:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf3fc380 with x1877056109495808 ext(0->18446744073709551615) 00002000:00010000:2.0:1790100454.312009:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bf3fc380. 00000100:00100000:0.0:1790100454.453337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100454.453469:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109495936 00000100:00100000:1.0:1790100454.453481:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109495936 00000100:00100000:1.0:1790100454.453548:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:1.0:1790100454.453558:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:11565:x1877056109495936:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:1.0:1790100454.454072:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.454092:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.454107:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.454125:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.454132:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.454140:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.455178:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.455664:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.455690:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100454.456110:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456124:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456131:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456139:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456146:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100454.456151:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456159:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456173:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:1.0:1790100454.456176:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100454.456181:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456188:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdbea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456293:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456308:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456315:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456320:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100454.456323:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456330:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456338:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6799df4100) 00010000:00010000:1.0:1790100454.456341:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100454.456344:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456351:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdbf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456367:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456374:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456381:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456386:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100454.456395:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456401:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456409:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:1.0:1790100454.456412:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100454.456415:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.456421:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefdbf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100454.456521:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:11565:x1877056109495936:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 2960us (3190us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100454.456531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 193 00000100:00100000:3.0:1790100454.516051:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.516464:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109496192 00000100:00100000:2.0:1790100454.516476:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109496192 00000100:00100000:2.0:1790100454.516544:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 194 00000100:00100000:2.0:1790100454.516556:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+32:11568:x1877056109496192:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100454.516577:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100454.516601:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdbff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64eef expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.516805:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.516820:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.516833:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.516851:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.516859:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.516885:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517602:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdc14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517640:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517650:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100454.517675:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790100454.517764:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517772:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517780:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517787:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100454.517792:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517800:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517814:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:2.0:1790100454.517817:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100454.517829:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517837:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517849:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517855:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517862:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517868:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100454.517871:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517877:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517885:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787def800) 00010000:00010000:2.0:1790100454.517887:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100454.517890:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.517897:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.518462:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdbff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eef expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.518492:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdc14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eef expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.518499:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:2.0:1790100454.518502:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790100454.518504:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143600, rc 0) 00000100:00100000:2.0:1790100454.518963:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+34:11568:x1877056109496192:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 2407us (2920us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1790100454.518973:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 194 00000100:00100000:0.0:1790100454.525019:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100454.525279:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109496320 00000100:00100000:3.0:1790100454.525289:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109496320 00000100:00100000:3.0:1790100454.525380:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:3.0:1790100454.525392:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+34:11568:x1877056109496320:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:3.0:1790100454.525457:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.525473:0:11548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eda expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.525496:0:11548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.525531:0:11548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eda expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.525545:0:11548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eda expref: 34 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100454.525559:0:11548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b151880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126260992:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100454.525728:0:11548:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818180 going to sleep for 11 seconds 00000100:00100000:3.0:1790100454.528388:0:11548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b151880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126260992:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100454.528418:0:11548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100454.532311:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100454.532397:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109496576 00000100:00100000:3.0:1790100454.532408:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109496576 00000100:00100000:3.0:1790100454.532470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:3.0:1790100454.532481:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:5592:x1877056109496576:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790100454.532984:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:5592:x1877056109496576:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 504us (681us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1790100454.532992:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:0.0:1790100454.536719:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.537252:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109496704 00000100:00100000:2.0:1790100454.537264:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109496704 00010000:00010000:2.0:1790100454.537313:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eda expref: 36 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100454.537397:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 74 00000100:00100000:2.0:1790100454.537407:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:2357:x1877056109496704:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100454.537422:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100454.537430:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eda expref: 36 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.537444:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eda expref: 36 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.537468:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdbc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eda expref: 36 pid: 5843 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.537503:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:2.0:1790100454.537508:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.537518:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.537526:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.537563:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100454.537728:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:2357:x1877056109496704:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 321us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100454.537736:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 74 00010000:00010000:1.0:1790100454.538065:0:11548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.538074:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.538107:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.538115:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.538122:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.538128:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100454.538146:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.538155:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.538165:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:1.0:1790100454.538169:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100454.538173:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.538180:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdc22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100454.538243:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+34:11568:x1877056109496320:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 12853us (13232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100454.538252:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 195 00000100:00100000:0.0:1790100454.543009:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100454.543157:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109496960 00000100:00100000:3.0:1790100454.543168:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109496960 00000100:00100000:3.0:1790100454.543342:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:3.0:1790100454.543353:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+34:11568:x1877056109496960:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100454.543648:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:11568:x1877056109496960:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 296us (647us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1790100454.543894:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:0.0:1790100454.649167:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100454.649373:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109497216 00000100:00100000:1.0:1790100454.649384:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109497216 00000100:00100000:1.0:1790100454.649476:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 196 00000100:00100000:1.0:1790100454.649487:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+35:11579:x1877056109497216:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:1.0:1790100454.649513:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100454.649535:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdc29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ef6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.649605:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.649667:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.649709:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.649727:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.649734:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.649741:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650044:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefdc3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650054:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefdc3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650062:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefdc3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100454.650072:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1790100454.650174:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650183:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650201:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650208:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100454.650221:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650230:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650242:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:1.0:1790100454.650245:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100454.650250:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650257:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdc30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650269:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650275:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650281:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650286:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100454.650289:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650294:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650300:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6799df4100) 00010000:00010000:1.0:1790100454.650303:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100454.650312:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650317:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefdc37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650365:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefdc29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ef6 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650379:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefdc3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ef6 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.650386:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:1.0:1790100454.650388:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100454.650390:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12600, rc 0) 00000100:00100000:1.0:1790100454.650462:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+37:11579:x1877056109497216:12345-192.168.201.18@tcp:101:cat.0 Request processed in 976us (1303us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790100454.650470:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 196 00000100:00100000:1.0:1790100454.657478:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.657606:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109497472 00000100:00100000:0.0:1790100454.657658:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109497472 00000100:00100000:0.0:1790100454.657894:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:0.0:1790100454.657921:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+37:11579:x1877056109497472:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:0.0:1790100454.658273:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:11579:x1877056109497472:12345-192.168.201.18@tcp:35:cat.0 Request processed in 355us (809us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1790100454.658281:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 54 00000100:00100000:3.0:1790100454.683995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.684668:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109497728 00000100:00100000:2.0:1790100454.684682:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109497728 00000100:00100000:2.0:1790100454.684775:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 197 00000100:00100000:2.0:1790100454.684787:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:11580:x1877056109497728:12345-192.168.201.18@tcp:36:rm.0 00010000:00010000:2.0:1790100454.684864:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790100454.684896:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefdc3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ef6 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.685062:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefdc14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64eef expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.685077:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefdbdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee1 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.685226:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787edfc00) 00010000:00010000:2.0:1790100454.685240:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100454.685266:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.685282:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.685293:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.685312:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.685320:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.685327:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.686022:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.686310:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.686323:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100454.689979:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1790100454.690008:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351259396008ns, next at 352259390705ns, rc = 0 00010000:00010000:2.0:1790100454.690217:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690240:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690263:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690281:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690288:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690295:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690329:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100454.690947:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690958:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690974:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690981:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100454.690985:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.690994:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.691024:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:2.0:1790100454.691034:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790100454.691041:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.691048:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdc5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.691079:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.691093:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.691100:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.691105:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100454.691108:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.691120:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.691128:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100454.691529:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100454.691538:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.691545:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100454.691549:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.691556:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.691567:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d6787deff00) 00010000:00010000:3.0:1790100454.691570:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790100454.691573:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.691579:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142600/0x31a8f3fdeeefdc61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.691599:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100454.691601:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100454.691603:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100454.691690:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100454.691694:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.691701:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefdc4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100454.691726:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015143ffa reply state 0000000095842ff9 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100454.691984:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100454.692113:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+37:11580:x1877056109497728:12345-192.168.201.18@tcp:36:rm.0 Request processed in 7323us (8128us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790100454.692124:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 197 00010000:00010000:2.0:1790100454.698601:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.698665:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.698675:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.698683:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100454.698690:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.699244:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.699268:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787def800) 00010000:00010000:2.0:1790100454.699272:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100454.699279:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.699285:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdc53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100454.751879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.753552:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109497984 00000100:00100000:0.0:1790100454.753571:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109497984 00000100:00100000:0.0:1790100454.753723:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 198 00000100:00100000:0.0:1790100454.753749:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+36:11586:x1877056109497984:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1790100454.753782:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100454.753810:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdc68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64efd expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.754542:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.754563:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.754579:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.754637:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.754647:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.754655:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790100454.756198:0:11548:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1790100454.757284:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.757307:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.757319:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.757540:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.757549:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.757557:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.757563:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100454.757569:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.757596:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.757721:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:0.0:1790100454.757726:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100454.757732:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.758307:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdc6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790100454.758326:0:11548:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b4bd176 reply state 00000000f93fb2b6 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100454.758336:0:11548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790100454.758444:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdc68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64efd expref: 39 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.758461:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64efd expref: 38 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100454.758469:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edfd00) 00010000:00010000:0.0:1790100454.758471:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100454.758474:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819800, rc 0) 00000100:00100000:0.0:1790100454.759009:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:11586:x1877056109497984:12345-192.168.201.18@tcp:101:bash.0 Request processed in 5273us (7144us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1790100454.759019:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 198 00010000:00010000:1.0:1790100454.759165:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100454.765671:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.766654:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109498112 00000100:00100000:2.0:1790100454.766671:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109498112 00000100:00100000:2.0:1790100454.766878:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:2.0:1790100454.766892:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109498112:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1790100454.766936:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100454.766966:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f04 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790100454.767006:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790100454.767044:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1790100454.767050:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100454.767062:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f04 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.767094:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f04 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.767109:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143a00, rc 0) 00000100:00100000:2.0:1790100454.767499:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109498112:12345-192.168.201.18@tcp:101:bash.0 Request processed in 608us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100454.767507:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00080000:0.0:1790100454.767595:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790100454.767839:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.767850:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.767858:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.767865:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100454.767877:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.767886:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.767916:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787edff00) 00010000:00010000:1.0:1790100454.767920:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100454.767983:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100454.767991:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdc76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100454.772130:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.772481:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109498240 00000100:00100000:2.0:1790100454.772495:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109498240 00000100:00100000:2.0:1790100454.772561:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:2.0:1790100454.772572:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:11586:x1877056109498240:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1790100454.772638:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100454.772663:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f0b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.772999:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f04 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.773010:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100454.773015:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100454.773030:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.773073:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f04 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.773309:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f04 expref: 7 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100454.773338:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787612300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877056126261120:192.168.201.18@tcp:104: 00000100:00100000:2.0:1790100454.773788:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d679339bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100454.782038:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100454.782234:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109498368 00000100:00100000:3.0:1790100454.782245:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109498368 00010000:00010000:3.0:1790100454.782300:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f04 expref: 8 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100454.782375:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:3.0:1790100454.782387:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109498368:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100454.782406:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100454.782435:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f04 expref: 8 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.782452:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f04 expref: 8 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.782482:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100454.782488:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100454.782498:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.782509:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.782556:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100454.782573:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1877056126261248:192.168.201.18@tcp:105: 00000100:00100000:3.0:1790100454.782714:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d679135cf00 going to sleep for 11 seconds 00010000:00010000:2.0:1790100454.785665:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c966e5b8/0x31a8f3fdeeefdc8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f04 expref: 8 pid: 6689 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100454.785818:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787612300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1877056126261120:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100454.785861:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100454.785913:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143c00, rc 0) 00000100:00100000:2.0:1790100454.786006:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:11586:x1877056109498240:12345-192.168.201.18@tcp:101:bash.0 Request processed in 13434us (13891us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100454.786016:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:3.0:1790100454.789109:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1877056126261248:192.168.201.18@tcp:105: 00010000:00010000:3.0:1790100454.789169:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100454.789235:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2357:x1877056109498368:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 6848us (7219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100454.789248:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:1.0:1790100454.793961:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.794066:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109498624 00000100:00100000:2.0:1790100454.794081:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109498624 00000100:00100000:2.0:1790100454.794170:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:2.0:1790100454.794181:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+38:11586:x1877056109498624:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1790100454.794946:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:11586:x1877056109498624:12345-192.168.201.18@tcp:35:bash.0 Request processed in 762us (996us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790100454.794957:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 55 00000100:00100000:0.0:1790100454.957456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.957525:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100454.957683:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109498752 00000100:00100000:2.0:1790100454.957697:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109498752 00000100:00100000:2.0:1790100454.957780:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 289 00000100:00100000:2.0:1790100454.957796:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2360:x1877056109498752:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100454.957955:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2360:x1877056109498752:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 162us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100454.957964:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 289 00000100:00100000:1.0:1790100454.965588:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109498880 00000100:00100000:1.0:1790100454.965672:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109498880 00000100:00100000:1.0:1790100454.965806:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 139 00000100:00100000:1.0:1790100454.965819:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2360:x1877056109498880:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100454.965954:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2360:x1877056109498880:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 137us (8428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100454.965962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 139 00000100:00080000:0.0:1790100454.967603:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100454.975331:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100454.975850:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109499008 00000100:00100000:3.0:1790100454.975863:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109499008 00000100:00100000:3.0:1790100454.976303:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:3.0:1790100454.976318:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+39:11602:x1877056109499008:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100454.976351:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100454.976378:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefdc99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f12 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.976469:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.976486:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.976500:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100454.976547:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790100454.976552:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100454.976573:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.976605:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae000/0x31a8f3fdeeefdc99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f12 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.976679:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f12 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100454.976699:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100454.976702:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100454.976707:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af400, rc 0) 00000100:00100000:3.0:1790100454.976786:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+40:11602:x1877056109499008:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 472us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100454.976794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 199 00000100:00100000:3.0:1790100454.980849:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100454.980972:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109499264 00000100:00100000:0.0:1790100454.980985:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109499264 00000100:00100000:0.0:1790100454.981067:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 200 00000100:00100000:0.0:1790100454.981079:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+40:11602:x1877056109499264:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100454.981106:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100455.135209:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdca7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f19 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.135422:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefdcae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.135450:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefdcae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.135467:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefdcae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100455.135507:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790100455.135739:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdca7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f19 expref: 43 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.136339:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefdcae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f19 expref: 42 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.136352:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edfd00) 00010000:00010000:1.0:1790100455.136355:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100455.136359:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12800, rc 0) 00000100:00100000:1.0:1790100455.136461:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+42:11602:x1877056109499264:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 155382us (155625us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1790100455.136471:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 200 00000100:00100000:1.0:1790100455.147027:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100455.147064:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100455.147147:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109499648 00000100:00100000:0.0:1790100455.147151:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109499520 00000100:00100000:3.0:1790100455.147167:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109499648 00000100:00100000:0.0:1790100455.147168:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109499520 00000100:00100000:0.0:1790100455.147279:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:0.0:1790100455.147290:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:11602:x1877056109499520:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100455.147315:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100455.147337:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdcbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f20 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100455.147353:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1790100455.147370:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+44:2357:x1877056109499648:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100455.147388:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100455.147420:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefdcae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f19 expref: 44 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.147447:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edfd00) 00010000:00010000:3.0:1790100455.147454:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100455.147771:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:2357:x1877056109499648:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 404us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100455.147780:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00010000:00010000:0.0:1790100455.148525:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdcc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.148547:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.148562:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100455.148604:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790100455.149444:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdcbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f20 expref: 44 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.149472:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdcc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f20 expref: 43 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.149501:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edfd00) 00010000:00010000:3.0:1790100455.149505:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790100455.149508:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818200, rc 0) 00000100:00100000:3.0:1790100455.151580:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:11602:x1877056109499520:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 4278us (4549us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1790100455.151596:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 201 00000100:00100000:1.0:1790100455.169587:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100455.171571:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109499776 00000100:00100000:3.0:1790100455.171587:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109499776 00000100:00100000:3.0:1790100455.171681:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:3.0:1790100455.171695:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+6:2358:x1877056109499776:12345-192.168.201.18@tcp:1:lfs.0 00010000:00010000:3.0:1790100455.171744:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.171766:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.171775:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100455.171780:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100455.171785:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.171826:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.171843:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 6 pid: 6689 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100455.171874:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6788c7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1877056126261376:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100455.171987:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b00cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100455.198597:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6788c7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1877056126261376:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100455.198664:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100455.199187:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100455.199393:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109499904 00000100:00100000:3.0:1790100455.199402:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109499904 00002000:00100000:3.0:1790100455.199454:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d67b5a80e00 x1877056109499904/t0(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:751/0 lens 504/0 e 0 to 0 dl 1790100466 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790100455.199466:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67b5a80e00 with x1877056109499904 ext(0->8) 00010000:00010000:3.0:1790100455.199474:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 7 pid: 6689 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.199491:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 7 pid: 6689 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100455.199499:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d67b5a80e00 00000100:00100000:3.0:1790100455.199531:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:3.0:1790100455.199541:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2357:x1877056109499904:12345-192.168.201.18@tcp:4:lfs.0 00000100:00100000:3.0:1790100455.200302:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2357:x1877056109499904:12345-192.168.201.18@tcp:4:lfs.0 Request processed in 757us (1111us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790100455.200313:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00002000:00100000:3.0:1790100455.200328:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d67b5a80e00 x1877056109499904/t4294967308(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:751/0 lens 504/448 e 0 to 0 dl 1790100466 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790100455.200338:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67b5a80e00 with x1877056109499904 ext(0->8) 00010000:00010000:3.0:1790100455.200345:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 9 pid: 6689 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.200360:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 9 pid: 6689 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100455.200367:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d67b5a80e00 00000100:00100000:0.0:1790100455.214496:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100455.216476:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109500032 00000100:00100000:3.0:1790100455.216493:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109500032 00010000:00010000:3.0:1790100455.216555:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 9 pid: 6689 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100455.216599:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:3.0:1790100455.216630:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2358:x1877056109500032:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100455.216650:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790100455.216677:0:12013:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790100455.216680:0:12013:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790100454 00002000:00010000:3.0:1790100455.216683:0:12013:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790100454 00002000:00010000:3.0:1790100455.216686:0:12013:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790100454 00010000:00010000:3.0:1790100455.216693:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 9 pid: 6689 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.217349:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 9 pid: 6689 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.217400:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce2bd72b/0x31a8f3fdeeefdc92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f0b expref: 9 pid: 6689 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.217421:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100455.217426:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100455.217433:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.217444:0:12013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.217488:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100455.217561:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109500032:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 953us (3084us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100455.218730:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00010000:00010000:1.0:1790100455.218858:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.218873:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.218931:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.218958:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.218967:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.218975:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100455.218981:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.218991:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.219019:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.219029:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefdcd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100455.219109:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109499776:12345-192.168.201.18@tcp:1:lfs.0 Request processed in 47417us (49533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100455.219119:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:0.0:1790100455.242834:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100455.245220:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109500288 00000100:00100000:3.0:1790100455.245241:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109500288 00000100:00100000:0.0:1790100455.245513:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 56 00000100:00100000:0.0:1790100455.245526:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67a93f6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+43:11602:x1877056109500288:12345-192.168.201.18@tcp:35:lfs.0 00000004:00010000:0.0:1790100455.246715:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdcc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f20 expref: 43 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100455.247606:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1790100455.248212:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1790100455.248571:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1790100455.249109:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.249134:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64efd expref: 47 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.249146:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.249197:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64efd expref: 47 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.249220:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64efd expref: 47 pid: 11548 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100455.249239:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1877056126261504:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100455.252418:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100455.263494:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1877056126261504:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100455.263538:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100455.276160:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100455.276299:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109500416 00000100:00100000:3.0:1790100455.276310:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109500416 00010000:00010000:3.0:1790100455.276355:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64efd expref: 48 pid: 11548 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100455.276451:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:3.0:1790100455.276462:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+48:2358:x1877056109500416:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100455.276481:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100455.276489:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64efd expref: 48 pid: 11548 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.276517:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64efd expref: 48 pid: 11548 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.276542:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdc7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64efd expref: 48 pid: 11548 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.276574:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edfd00) 00010000:00010000:3.0:1790100455.276580:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.276590:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.276599:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100455.276665:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100455.276727:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+47:2358:x1877056109500416:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 266us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100455.276735:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00010000:00010000:1.0:1790100455.276981:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.276990:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100455.277137:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1790100455.277336:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1790100455.277438:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126261632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790100455.277504:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100455.277537:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790100455.277588:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126261632 00000100:00100000:1.0:1790100455.277595:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126261632 00000100:00100000:1.0:1790100455.277660:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100455.277667:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1877056126261632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790100455.277731:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1877056126261632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100455.277959:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790100455.278004:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1790100455.278009:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1790100455.278026:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67bf3fd180, transno 4294967307 00000100:00100000:1.0:1790100455.278039:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126261632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790100455.278425:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1790100455.278473:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126261760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790100455.278502:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100455.278527:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7480 going to sleep for 11 seconds 00000100:00080000:1.0:1790100455.278974:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100455.280923:0:12069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126261760 00000100:00100000:3.0:1790100455.280938:0:12069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126261760 00000100:00100000:3.0:1790100455.281038:0:12069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100455.281049:0:12069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5844:x1877056126261760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790100455.281456:0:12069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5844:x1877056126261760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 409us (2951us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790100455.281465:0:12069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790100455.281578:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1877056126261760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790100455.281674:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1790100455.281725:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.281747:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.281756:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.281762:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100455.281767:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.281774:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.281791:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edfd00) 00010000:00010000:0.0:1790100455.281794:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790100455.281798:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.281805:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdcd8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790100455.282007:0:5844:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790100455.282105:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1790100455.282116:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351851504023ns, next at 352851502179ns, rc = 0 00000001:00080000:0.0:1790100455.282122:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1790100455.282177:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edfd00) 00010000:00010000:0.0:1790100455.282181:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790100455.282187:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdcc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f20 expref: 51 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100455.282281:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67a93f6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:11602:x1877056109500288:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 36758us (39463us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1790100455.282290:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 56 00000020:00080000:0.0:1790100455.282295:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790100455.285960:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100455.286109:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109500544 00000100:00100000:0.0:1790100455.286120:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109500544 00000100:00100000:0.0:1790100455.286275:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 202 00000100:00100000:0.0:1790100455.286286:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+50:11602:x1877056109500544:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100455.286310:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100455.286333:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdcdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f27 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.286399:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdcdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f27 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.286415:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdcdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f27 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.286434:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:0.0:1790100455.286437:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790100455.286441:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818a00, rc 0) 00000100:00100000:0.0:1790100455.286512:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:11602:x1877056109500544:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 228us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100455.286535:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 202 00000100:00100000:0.0:1790100455.290080:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100455.290440:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109500800 00000100:00100000:3.0:1790100455.290451:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109500800 00000100:00100000:3.0:1790100455.290540:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:3.0:1790100455.290551:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+51:11602:x1877056109500800:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100455.290959:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:11602:x1877056109500800:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 409us (889us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1790100455.290968:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 57 00000100:00100000:3.0:1790100455.391294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100455.391407:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109500928 00000100:00100000:1.0:1790100455.391420:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109500928 00000100:00100000:1.0:1790100455.391499:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:1.0:1790100455.391511:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6788c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:11612:x1877056109500928:12345-192.168.201.18@tcp:34:lfs.0 00010000:00010000:1.0:1790100455.391660:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.391681:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.391696:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.391713:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.391721:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.391728:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.391851:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.391859:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.391867:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100455.391956:0:11548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.391970:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392102:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392111:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392117:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100455.392122:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392131:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392144:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:1.0:1790100455.392148:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100455.392153:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392159:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefdce6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392175:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392181:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392193:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392199:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100455.392202:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392208:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392215:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6799df4100) 00010000:00010000:1.0:1790100455.392218:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100455.392222:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392227:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdced lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392244:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392251:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392256:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392262:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100455.392265:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392280:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392289:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:1.0:1790100455.392291:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100455.392294:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100455.392301:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefdcf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100455.392438:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6788c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:11612:x1877056109500928:12345-192.168.201.18@tcp:34:lfs.0 Request processed in 927us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100455.392447:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 203 00000100:00100000:1.0:1790100455.655278:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67876a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126261888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100455.655395:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100455.655581:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126261888 00000100:00100000:0.0:1790100455.655591:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126261888 00000100:00100000:0.0:1790100455.655698:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790100455.655709:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877056126261888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100455.655769:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790100455.656057:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100455.661673:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877056126261888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5952us (6263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100455.661694:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790100455.662472:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67876a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126261888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100455.665862:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126262016:0@lo:400:kworker.0 00000100:00100000:0.0:1790100455.665974:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100455.666135:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126262144:0@lo:400:kworker.0 00000100:00100000:3.0:1790100455.666184:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100455.666215:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100455.666216:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100455.666222:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126262272:0@lo:400:kworker.0 00000100:00100000:0.0:1790100455.666229:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126262400:0@lo:400:kworker.0 00000100:00100000:3.0:1790100455.666250:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100455.666274:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100455.666289:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126262144 00000100:00100000:3.0:1790100455.666299:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126262144 00000100:00100000:0.0:1790100455.666341:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126262400 00000100:00100000:0.0:1790100455.666347:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126262400 00000100:00100000:3.0:1790100455.666365:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126262272 00000100:00100000:3.0:1790100455.666370:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126262272 00000100:00100000:0.0:1790100455.666393:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790100455.666406:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126262400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100455.666418:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790100455.666427:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67876a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126262144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100455.666472:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1877056126262400:12345-0@lo:400:kworker.0 Request processed in 69us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100455.666480:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790100455.666498:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67876a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126262144:12345-0@lo:400:kworker.0 Request processed in 72us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100455.666507:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790100455.666524:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790100455.666531:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126262272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100455.666536:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126262400:0@lo:400:kworker.0 00000100:00100000:3.0:1790100455.666566:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126262272:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00080000:0.0:1790100455.666582:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100455.666595:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790100455.666665:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126262272:0@lo:400:kworker.0 00000100:00100000:3.0:1790100455.666678:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126262144:0@lo:400:kworker.0 00000100:00100000:0.0:1790100455.666998:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126262528:0@lo:400:kworker.0 00000100:00100000:0.0:1790100455.667040:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100455.667538:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126262528 00000100:00100000:2.0:1790100455.667546:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126262528 00000100:00100000:2.0:1790100455.667604:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790100455.667635:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126262528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100455.667686:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126262528:12345-0@lo:400:kworker.0 Request processed in 76us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100455.667705:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790100455.667740:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126262528:0@lo:400:kworker.0 00000100:00100000:0.0:1790100455.671663:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126262016 00000100:00100000:0.0:1790100455.671688:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126262016 00000100:00100000:0.0:1790100455.672022:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1790100455.672036:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126262016:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790100455.672158:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100455.672236:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3312:x1877056126262016:12345-0@lo:400:kworker.0 Request processed in 203us (6262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100455.672246:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1790100455.672275:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126262016:0@lo:400:kworker.0 00010000:00010000:3.0:1790100455.781920:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100455.829587:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100455.832910:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109501184 00000100:00100000:0.0:1790100455.832934:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109501184 00000100:00100000:0.0:1790100455.833118:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 204 00000100:00100000:0.0:1790100455.833133:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+52:11615:x1877056109501184:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100455.833164:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100455.833191:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdcfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835472:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835501:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835517:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835537:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835545:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835571:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835746:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835755:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835764:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100455.835778:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790100455.835917:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835925:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835932:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835938:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100455.835943:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835952:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835966:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:0.0:1790100455.835969:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100455.835982:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.835989:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836006:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836013:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836019:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836024:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100455.836027:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836033:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836041:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787edfd00) 00010000:00010000:0.0:1790100455.836043:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100455.836046:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836052:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836112:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdcfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f2e expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836142:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f2e expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100455.836149:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:0.0:1790100455.836152:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100455.836154:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819c00, rc 0) 00000100:00100000:0.0:1790100455.836257:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:11615:x1877056109501184:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 3126us (6684us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1790100455.836469:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 204 00000100:00100000:1.0:1790100455.845340:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100455.845487:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109501312 00000100:00100000:2.0:1790100455.845501:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109501312 00000100:00100000:2.0:1790100455.845579:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:2.0:1790100455.845592:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:11615:x1877056109501312:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1790100455.845716:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.845905:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.845922:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.845966:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.845975:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.845984:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.845991:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100455.845997:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.846007:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.846045:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:2.0:1790100455.846049:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100455.846055:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100455.846062:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100455.846268:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:11615:x1877056109501312:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 677us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100455.846278:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 205 00000100:00100000:1.0:1790100455.859298:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100455.863566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109501568 00000100:00100000:2.0:1790100455.863587:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109501568 00000100:00100000:3.0:1790100455.868268:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:3.0:1790100455.868295:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+54:11615:x1877056109501568:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100455.868657:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:11615:x1877056109501568:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 372us (9374us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1790100455.868666:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 58 00000100:00100000:1.0:1790100456.061871:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100456.062285:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109501824 00000100:00100000:2.0:1790100456.062295:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109501824 00000100:00100000:2.0:1790100456.062362:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:2.0:1790100456.062370:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+55:11625:x1877056109501824:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:2.0:1790100456.062392:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100456.062394:0:11548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790100456.062418:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefdca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f12 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.062434:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:2.0:1790100456.062438:0:11548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100456.062449:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f35 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.062542:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdd2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.062564:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdd2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.062572:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdd2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100456.062581:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790100456.062865:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f35 expref: 57 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.062887:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdd2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f35 expref: 56 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.062895:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:2.0:1790100456.062898:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100456.062901:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142400, rc 0) 00000100:00080000:3.0:1790100456.063263:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100456.063511:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:11625:x1877056109501824:12345-192.168.201.18@tcp:101:bash.0 Request processed in 1138us (1646us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1790100456.063519:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 206 00000100:00100000:1.0:1790100456.069354:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100456.070344:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109502080 00000100:00100000:0.0:1790100456.070360:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109502080 00000100:00100000:0.0:1790100456.070439:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 207 00000100:00100000:0.0:1790100456.070452:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:11625:x1877056109502080:12345-192.168.201.18@tcp:36:bash.0 00010000:00010000:0.0:1790100456.072510:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790100456.072928:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefdd2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f35 expref: 56 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.073091:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f2e expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.073103:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:0.0:1790100456.073181:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790100456.073433:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.073449:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.073474:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790100456.073528:0:5841:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1790100456.077451:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fce7fb7e reply state 00000000d3391c43 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.077471:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790100456.077873:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11625:x1877056109502080:12345-192.168.201.18@tcp:36:bash.0 Request processed in 7416us (8760us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1790100456.077891:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 207 00000020:00080000:0.0:1790100456.077898:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790100456.088184:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:2.0:1790100456.088275:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.088289:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.088297:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.088303:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100456.088322:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.088332:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.088350:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:2.0:1790100456.088354:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100456.088360:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.088368:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.088856:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109502208 00000100:00100000:0.0:1790100456.088870:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109502208 00000100:00100000:0.0:1790100456.088941:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 208 00000100:00100000:0.0:1790100456.088952:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+56:11625:x1877056109502208:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:0.0:1790100456.088977:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100456.088995:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f3c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.089086:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.089100:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.089121:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100456.089165:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790100456.089169:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100456.089187:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.089212:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f3c expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.089228:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f3c expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.089236:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:0.0:1790100456.089239:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100456.089241:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819a00, rc 0) 00000100:00100000:0.0:1790100456.089294:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11625:x1877056109502208:12345-192.168.201.18@tcp:101:bash.0 Request processed in 344us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100456.089302:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 208 00000100:00100000:1.0:1790100456.099700:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100456.100564:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109502464 00000100:00100000:2.0:1790100456.100576:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109502464 00000100:00100000:2.0:1790100456.100664:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:2.0:1790100456.100674:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+57:11625:x1877056109502464:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:2.0:1790100456.100925:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:11625:x1877056109502464:12345-192.168.201.18@tcp:35:bash.0 Request processed in 251us (1232us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1790100456.100933:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 59 00000100:00100000:3.0:1790100456.351511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100456.359744:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109502592 00000100:00100000:0.0:1790100456.359766:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109502592 00000100:00100000:0.0:1790100456.359865:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:0.0:1790100456.359888:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+58:11631:x1877056109502592:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100456.359917:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100456.359958:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f43 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.360225:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.360257:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.360271:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100456.360437:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790100456.360441:0:6711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100456.360460:0:6711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.360486:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f43 expref: 60 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.360507:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f43 expref: 59 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.360516:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:0.0:1790100456.360519:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100456.360523:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819000, rc 0) 00000100:00100000:0.0:1790100456.360588:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:11631:x1877056109502592:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 703us (9085us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100456.360596:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 209 00000100:00100000:1.0:1790100456.367740:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100456.367850:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109502720 00000100:00100000:0.0:1790100456.367862:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109502720 00000100:00100000:0.0:1790100456.367938:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:0.0:1790100456.367949:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:11631:x1877056109502720:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100456.367971:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100456.368017:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368085:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368099:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368119:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368134:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368141:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368147:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368234:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368243:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368249:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100456.368282:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790100456.368769:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100456.368794:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368937:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368948:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368955:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368962:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368968:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100456.368972:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.368981:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369391:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:0.0:1790100456.369396:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100456.369403:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369410:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818200/0x31a8f3fdeeefdd64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369427:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369434:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369449:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369454:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100456.369458:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369464:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369473:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787edfd00) 00010000:00010000:0.0:1790100456.369476:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100456.369478:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369484:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819800/0x31a8f3fdeeefdd6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369521:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefdd5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369549:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.369557:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:0.0:1790100456.369559:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790100456.369561:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818800, rc 0) 00000100:00100000:0.0:1790100456.369819:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:11631:x1877056109502720:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 1861us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100456.369838:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 210 00000100:00100000:1.0:1790100456.385674:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100456.385714:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100456.386080:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109503104 00000100:00100000:0.0:1790100456.386093:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109503104 00000100:00100000:0.0:1790100456.386153:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:0.0:1790100456.386165:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:11631:x1877056109503104:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:0.0:1790100456.386187:0:11548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100456.386208:0:11548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdd79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f51 expref: -99 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.386351:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.386369:0:11548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f3c expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.386378:0:11548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.386387:0:11548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.386426:0:11548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.386441:0:11548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 61 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.386455:0:11548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126262656:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100456.386575:0:11548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f3c expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.386585:0:11548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f3c expref: 61 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.386595:0:11548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126262784:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100456.386659:0:11548:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100456.388258:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109502848 00000100:00100000:3.0:1790100456.388271:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109502848 00010000:00010000:3.0:1790100456.388327:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 62 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100456.388376:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:3.0:1790100456.388386:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:2357:x1877056109502848:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100456.388400:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100456.388406:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 62 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.388436:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 62 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.388458:0:12013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:3.0:1790100456.388463:0:12013:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.388471:0:12013:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.388478:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100456.388523:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:2357:x1877056109502848:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 138us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.390046:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00010000:00010000:0.0:1790100456.398277:0:11548:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.18@tcp) returned -22 from blocking AST (req@00000000cb19150e x1877056126262656) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 61 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.398317:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818800/0x31a8f3fdeeefdd72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f4a expref: 61 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.398338:0:11548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126262656:192.168.201.18@tcp:104: 00000100:00100000:0.0:1790100456.398352:0:11548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11548:1877056126262784:192.168.201.18@tcp:104: 00010000:00010000:0.0:1790100456.398379:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:0.0:1790100456.398386:0:11548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.398395:0:11548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.398404:0:11548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100456.407346:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.407538:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109503232 00000100:00100000:3.0:1790100456.407550:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109503232 00010000:00010000:3.0:1790100456.407596:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f3c expref: 61 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100456.407859:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:3.0:1790100456.407881:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:2358:x1877056109503232:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100456.407899:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100456.407907:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f3c expref: 61 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.407921:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f3c expref: 61 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.407968:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819a00/0x31a8f3fdeeefdd48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f3c expref: 61 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.407984:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:3.0:1790100456.407989:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.408007:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.408015:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.408050:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100456.408103:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:2358:x1877056109503232:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 234us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.408111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00010000:00010000:1.0:1790100456.408357:0:11548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.408367:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100456.408389:0:11548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790100456.408564:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818600/0x31a8f3fdeeefdd79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f51 expref: 61 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.408581:0:11548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f51 expref: 60 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.408589:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:1.0:1790100456.408592:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790100456.408595:0:11548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819200, rc 0) 00000100:00100000:1.0:1790100456.408673:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:11631:x1877056109503104:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 22511us (22958us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1790100456.408682:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 211 00000100:00100000:1.0:1790100456.424451:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.424824:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109503488 00000100:00100000:3.0:1790100456.424836:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109503488 00000100:00100000:3.0:1790100456.424990:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1790100456.425002:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:11631:x1877056109503488:12345-192.168.201.18@tcp:103:lfs.0 00010000:00010000:3.0:1790100456.425019:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100456.425045:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818a00/0x31a8f3fdeeefdcdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f27 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.425065:0:12013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:3.0:1790100456.425070:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100456.425156:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:11631:x1877056109503488:12345-192.168.201.18@tcp:103:lfs.0 Request processed in 156us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.425165:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1790100456.431692:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100456.431782:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109503616 00000100:00100000:2.0:1790100456.431794:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109503616 00000100:00100000:2.0:1790100456.431861:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:2.0:1790100456.431883:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:11631:x1877056109503616:12345-192.168.201.18@tcp:58:lfs.0 00010000:00010000:2.0:1790100456.432066:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.432084:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.432112:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100456.432504:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1790100456.433129:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:11631:x1877056109503616:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 1255us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.433139:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 212 00000100:00100000:1.0:1790100456.461183:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.462116:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109503744 00000100:00100000:3.0:1790100456.462128:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109503744 00000100:00100000:3.0:1790100456.462194:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 213 00000100:00100000:3.0:1790100456.462205:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+59:11631:x1877056109503744:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100456.462228:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100456.462250:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdd95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f58 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.462323:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.462335:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdd95 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f58 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.462356:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.462369:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdd95 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f58 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.462383:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:3.0:1790100456.462387:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100456.462390:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdd95 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f58 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.462416:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af800, rc 0) 00000100:00100000:3.0:1790100456.462490:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+60:11631:x1877056109503744:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 286us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.462498:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 213 00000004:00080000:2.0:1790100456.678432:0:6834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353247818372ns, next at 354247816327ns, rc = 0 00000100:00100000:2.0:1790100456.678450:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100456.678469:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126262912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100456.678541:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100456.678601:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126262912 00000100:00100000:2.0:1790100456.678608:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126262912 00000100:00100000:2.0:1790100456.678677:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790100456.678685:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1877056126262912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100456.678717:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100456.678959:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1877056126262912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 273us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.678967:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790100456.679023:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126262912:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1790100456.683527:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100456.683553:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100456.683600:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1790100456.683608:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100456.687842:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126263040:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790100456.714528:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100456.714820:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109503872 00000100:00100000:1.0:1790100456.714833:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109503872 00000100:00100000:1.0:1790100456.714892:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 214 00000100:00100000:1.0:1790100456.714901:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109503872:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790100456.714932:0:11548:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790100456.715045:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109503872:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 144us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100456.715065:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 214 00000100:00100000:1.0:1790100456.720378:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.721383:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109504000 00000100:00100000:3.0:1790100456.721396:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109504000 00000100:00100000:3.0:1790100456.721454:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:3.0:1790100456.721463:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109504000:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790100456.721552:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.721571:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.721582:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.721640:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.721648:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.721655:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.721679:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.721702:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.721709:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100456.721889:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790100456.721894:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100456.721907:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722048:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722059:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722066:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722072:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100456.722076:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722084:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722095:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:3.0:1790100456.722167:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100456.722173:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722188:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdd9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722202:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722207:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722213:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722217:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aea00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100456.722219:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722224:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722231:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d6787ec1d00) 00010000:00010000:3.0:1790100456.722233:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100456.722235:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722240:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefdda3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722254:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722259:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722268:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722273:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100456.722275:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722280:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722286:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:3.0:1790100456.722287:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100456.722290:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.722294:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100456.722364:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109504000:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 900us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.722371:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 215 00000100:00100000:3.0:1790100456.732427:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100456.732510:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109504256 00000100:00100000:1.0:1790100456.732529:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109504256 00000100:00100000:1.0:1790100456.732589:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:1.0:1790100456.732598:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109504256:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100456.732653:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100456.732675:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefddb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f5f expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.732789:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.732806:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.732817:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100456.732831:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790100456.732955:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.732964:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.732971:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.732977:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100456.733008:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.733016:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.733033:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:1.0:1790100456.733037:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100456.733044:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.733050:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.733421:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefddb1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f5f expref: 63 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.733432:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:1.0:1790100456.733438:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100456.733442:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefddb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f5f expref: 63 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.733451:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12c00, rc 0) 00000100:00100000:1.0:1790100456.733504:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11632:x1877056109504256:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 907us (1086us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1790100456.733511:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 216 00000100:00100000:1.0:1790100456.735653:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45840 going to sleep for 11 seconds 00000100:00100000:1.0:1790100456.735703:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126263040:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790100456.741532:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.741599:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109504384 00000100:00100000:3.0:1790100456.741651:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109504384 00000100:00100000:3.0:1790100456.741709:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:3.0:1790100456.741719:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109504384:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790100456.741756:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790100456.741859:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109504384:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 141us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.741896:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 217 00000100:00100000:1.0:1790100456.757558:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.757649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109504640 00000100:00100000:3.0:1790100456.757661:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109504640 00000100:00100000:3.0:1790100456.757721:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 218 00000100:00100000:3.0:1790100456.757731:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109504640:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100456.757765:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100456.757768:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790100456.757797:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefdd56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f43 expref: 61 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.757817:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100456.757822:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100456.757836:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f66 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790100456.758237:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1790100456.758400:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefddcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.758414:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefddcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.758424:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefddcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.758465:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefddc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f66 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.758493:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefddcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f66 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.758501:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6787ec1d00) 00010000:00010000:3.0:1790100456.758504:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100456.758506:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900aea00, rc 0) 00000100:00100000:3.0:1790100456.758932:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11632:x1877056109504640:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1199us (1381us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1790100456.758940:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 218 00000100:00100000:2.0:1790100456.768734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.769280:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109504896 00000100:00100000:3.0:1790100456.769292:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109504896 00000100:00100000:3.0:1790100456.769352:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:3.0:1790100456.769361:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11632:x1877056109504896:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790100456.769422:0:11548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100456.769451:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefddcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f66 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769469:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6787ec1d00) 00010000:00010000:3.0:1790100456.769478:0:11548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790100456.769500:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769513:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769533:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769598:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769606:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769664:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769727:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769735:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769879:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769886:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100456.769892:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769900:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769908:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100456.769911:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100456.769915:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769920:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefdddb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.769940:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.770059:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.770065:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.770070:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100456.770073:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.770081:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.770089:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd4da7817 (ffff8d6787ec1c00) 00010000:00010000:3.0:1790100456.770091:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100456.770094:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.770844:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefdde2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd4da7817 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100456.774216:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109504896:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 4844us (5480us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790100456.774226:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 219 00000100:00100000:2.0:1790100456.792493:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100456.792656:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109505024 00000100:00100000:1.0:1790100456.792670:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109505024 00000100:00100000:1.0:1790100456.792732:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 220 00000100:00100000:1.0:1790100456.792743:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+61:11632:x1877056109505024:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100456.792764:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100456.792796:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdde9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f6d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.792842:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.792959:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.792980:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.793283:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefdde9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f6d expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.793841:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f6d expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.793858:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:1.0:1790100456.793870:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790100456.793876:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12a00, rc 0) 00000100:00100000:1.0:1790100456.793944:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11632:x1877056109505024:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1203us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100456.793952:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 220 00000100:00100000:1.0:1790100456.798760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100456.798859:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109505280 00000100:00100000:0.0:1790100456.798880:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109505280 00000100:00100000:0.0:1790100456.798972:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:0.0:1790100456.798983:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+62:11632:x1877056109505280:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790100456.799207:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.799224:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.799236:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100456.799458:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1790100456.799465:0:6711:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353368854183ns, next at 354368852520ns, rc = 0 00000004:00010000:0.0:1790100456.799546:0:6711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045b2f4c3 reply state 00000000b6eeb4d5 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.799555:0:6711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790100456.799856:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+64:11632:x1877056109505280:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 873us (1105us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1790100456.799872:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 221 00000100:00100000:2.0:1790100456.802568:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.803214:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109505408 00010000:00010000:0.0:1790100456.803255:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.803267:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.803275:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.803296:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100456.803301:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.803309:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.803327:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:0.0:1790100456.803329:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790100456.803334:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.803340:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819c00/0x31a8f3fdeeefddf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100456.803411:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109505408 00000100:00100000:1.0:1790100456.803536:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 222 00000100:00100000:1.0:1790100456.803545:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+63:11632:x1877056109505408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100456.803569:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100456.803585:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f74 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.803662:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f74 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.803677:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f74 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.803694:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:1.0:1790100456.803697:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100456.803700:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13600, rc 0) 00000100:00100000:1.0:1790100456.803763:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+64:11632:x1877056109505408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 217us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100456.803770:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 222 00010000:00010000:1.0:1790100456.806502:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100456.806854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.806922:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109505536 00000100:00100000:3.0:1790100456.806947:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109505536 00000100:00100000:3.0:1790100456.807028:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:3.0:1790100456.807037:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2357:x1877056109505536:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1790100456.807454:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100456.808247:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:2357:x1877056109505536:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 1205us (1391us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1790100456.808257:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:0.0:1790100456.810908:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100456.810986:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109505792 00000100:00100000:2.0:1790100456.811309:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109505792 00000100:00100000:2.0:1790100456.811410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:2.0:1790100456.811420:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+64:11632:x1877056109505792:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790100456.811773:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+65:11632:x1877056109505792:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 350us (868us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1790100456.811784:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 60 00000100:00100000:2.0:1790100456.814492:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100456.814588:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109506048 00000100:00100000:1.0:1790100456.814598:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109506048 00000100:00100000:1.0:1790100456.814732:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:1.0:1790100456.814754:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+65:11632:x1877056109506048:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790100456.814890:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+65:11632:x1877056109506048:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 149us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100456.814897:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 223 00000100:00100000:0.0:1790100456.817125:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100456.817468:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109506176 00000100:00100000:2.0:1790100456.817481:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109506176 00000100:00100000:2.0:1790100456.817734:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 224 00000100:00100000:2.0:1790100456.817772:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+65:11632:x1877056109506176:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100456.817813:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100456.817850:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefde05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f7b expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.818026:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.818048:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.818064:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100456.818121:0:6711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100456.818145:0:6711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.818189:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefde05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f7b expref: 67 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.818232:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f7b expref: 66 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.818245:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:2.0:1790100456.818248:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790100456.818254:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142c00, rc 0) 00000100:00100000:2.0:1790100456.818342:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+66:11632:x1877056109506176:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 579us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.818351:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 224 00000100:00100000:1.0:1790100456.822222:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100456.822282:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109506304 00000100:00100000:0.0:1790100456.822292:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109506304 00000100:00100000:0.0:1790100456.822371:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:0.0:1790100456.822380:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+10:2357:x1877056109506304:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100456.822397:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100456.822415:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f82 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790100456.822438:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c3e8, blocks: 0x1 00010000:00010000:0.0:1790100456.822471:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1790100456.822475:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100456.822484:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f82 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.822500:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f82 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.822513:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818200, rc 0) 00000100:00100000:0.0:1790100456.822584:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:2357:x1877056109506304:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 205us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100456.822595:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:3.0:1790100456.825751:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100456.826204:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109506560 00000100:00100000:2.0:1790100456.826220:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109506560 00000100:00100000:2.0:1790100456.826289:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 225 00000100:00100000:2.0:1790100456.826304:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+66:11632:x1877056109506560:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790100456.826554:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+66:11632:x1877056109506560:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 253us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.826566:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 225 00000100:00100000:3.0:1790100456.829450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100456.829523:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109506688 00000100:00100000:1.0:1790100456.829534:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109506688 00000100:00100000:1.0:1790100456.829586:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:1.0:1790100456.829594:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+11:11632:x1877056109506688:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100456.829637:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100456.829656:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f89 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.829714:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f82 expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.829724:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100456.829730:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100456.829735:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.829769:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f82 expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.829785:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f82 expref: 12 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100456.829814:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877056126263168:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100456.829921:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7180 going to sleep for 11 seconds 00000100:00100000:3.0:1790100456.833014:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100456.833111:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109506816 00000100:00100000:0.0:1790100456.833121:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109506816 00010000:00010000:0.0:1790100456.833158:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f82 expref: 13 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.833200:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:0.0:1790100456.833208:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f85450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2358:x1877056109506816:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100456.833222:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100456.833243:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f82 expref: 13 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.833255:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f82 expref: 13 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.833297:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100456.833302:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100456.833310:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 13 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.833320:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 13 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100456.833354:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 13 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.833366:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1877056126263296:192.168.201.18@tcp:105: 00000100:00100000:0.0:1790100456.833438:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784e45c00 going to sleep for 11 seconds 00010000:00010000:1.0:1790100456.834170:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fffadd8c/0x31a8f3fdeeefde13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f82 expref: 13 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100456.834186:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1877056126263168:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100456.834215:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100456.834226:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12800, rc 0) 00000100:00100000:1.0:1790100456.834295:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:11632:x1877056109506688:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 4701us (4854us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100456.834303:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:3.0:1790100456.881937:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100456.882151:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109506944 00000100:00100000:2.0:1790100456.882161:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109506944 00002000:00100000:2.0:1790100456.882213:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8d67bf975880 x1877056109506944/t0(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:752/0 lens 504/0 e 0 to 0 dl 1790100467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100456.882226:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf975880 with x1877056109506944 ext(0->12) 00002000:00010000:2.0:1790100456.882232:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bf975880 00000100:00100000:2.0:1790100456.882274:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:2.0:1790100456.882284:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+12:2358:x1877056109506944:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790100456.882875:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:2358:x1877056109506944:12345-192.168.201.18@tcp:4:lhsmtool_posix.0 Request processed in 579us (936us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1790100456.882885:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00002000:00100000:2.0:1790100456.882893:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8d67bf975880 x1877056109506944/t4294967320(0) o4->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:752/0 lens 504/448 e 0 to 0 dl 1790100467 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790100456.882901:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bf975880 with x1877056109506944 ext(0->12) 00002000:00010000:2.0:1790100456.882905:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bf975880 00000100:00100000:0.0:1790100456.883059:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1877056126263296:192.168.201.18@tcp:105: 00010000:00010000:0.0:1790100456.883083:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100456.883120:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f85450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2358:x1877056109506816:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 49912us (50117us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100456.883129:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:2.0:1790100456.886165:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.886249:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109507072 00000100:00100000:3.0:1790100456.886260:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109507072 00000100:00100000:3.0:1790100456.886320:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 226 00000100:00100000:3.0:1790100456.886331:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+66:11632:x1877056109507072:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1790100456.943307:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+66:11632:x1877056109507072:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 56958us (57131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100456.943330:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 226 00000001:00080000:0.0:1790100456.943508:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1790100456.943518:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1790100456.943567:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1790100456.943669:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d6788dc7c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1790100456.943674:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ae5fd600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d6788dc76c0 00000020:00080000:0.0:1790100456.943677:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ae5fd100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d66830c2800 00000001:00080000:0.0:1790100456.943714:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1790100456.943720:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:0.0:1790100456.943729:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1790100456.943742:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d67b2758180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1790100456.943745:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ad81a900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d6782c66d80 00000020:00080000:0.0:1790100456.943749:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ad81a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d67bf97a400 00000020:00080000:0.0:1790100456.943793:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1790100456.943970:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1790100456.944217:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126263552:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790100456.944323:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100456.944413:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100456.944424:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126263680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790100456.944485:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100456.944545:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126263552 00000100:00100000:3.0:1790100456.944557:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126263552 00000100:00100000:3.0:1790100456.944637:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126263680 00000100:00100000:3.0:1790100456.944643:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126263680 00000100:00100000:3.0:1790100456.944680:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790100456.944689:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1877056126263552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790100456.944718:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1790100456.944745:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.944870:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee8 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.944902:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1790100456.944910:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100456.944920:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.944954:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee8 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.944969:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee8 expref: 12 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100456.944982:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1877056126263808:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100456.945188:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf818180 going to sleep for 11 seconds 00000100:00100000:3.0:1790100456.945220:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000020:00080000:0.0:1790100456.945567:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790100456.945586:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100456.945603:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126263424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790100456.945673:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100456.945701:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126263424 00000100:00100000:0.0:1790100456.945708:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126263424 00000100:00100000:3.0:1790100456.945999:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1877056126263680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790100456.946154:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790100456.946160:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790100456 00002000:00010000:3.0:1790100456.946180:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790100456.946185:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790100456 -> 1790100456 00002000:00010000:3.0:1790100456.946187:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:2.0:1790100456.946355:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67bf975f80/2, rc 0, transno 4294967321 00000100:00100000:2.0:1790100456.946367:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126263680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790100456.946414:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1877056126263680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 286us (1788us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790100456.950826:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790100456.950902:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790100456.950929:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126263424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1790100456.950964:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1790100456.951312:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ab2c3e6, atime: 0x6ab2c3e6, ctime: 0x6ab2c3e6, blocks: 0x1 00010000:00010000:2.0:1790100456.951329:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.951355:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1790100456.951362:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100456.951374:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.951401:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.951419:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.951462:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.951497:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790100456.952498:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1877056126263424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1578us (6816us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790100456.952515:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1790100456.952685:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67bb9f0380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1790100456.952692:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126263424:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790100456.952755:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100456.952766:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.952779:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100456.952789:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.952805:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.952839:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.952852:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c682b2/0x31a8f3fdeeefde28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100456.952892:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100456.952909:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100456.952911:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100456.954685:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100456.954753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100456.954918:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787773b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1877056126263808:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100456.954947:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100456.955076:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109507200 00000100:00100000:0.0:1790100456.955090:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109507200 00000100:00100000:0.0:1790100456.955173:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:0.0:1790100456.955188:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2358:x1877056109507200:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790100456.958497:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109507328 00000100:00100000:2.0:1790100456.958523:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109507328 00010000:00010000:2.0:1790100456.958597:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee8 expref: 14 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100456.958669:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:2.0:1790100456.958679:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+14:2357:x1877056109507328:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790100456.958693:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100456.958699:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee8 expref: 14 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.958716:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee8 expref: 14 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.958746:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee723ae4/0x31a8f3fdeeefdbe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ee8 expref: 14 pid: 6687 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.958797:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100456.958805:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100456.958816:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.958834:0:12013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.958890:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100456.958962:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+13:2357:x1877056109507328:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 284us (4208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100456.958970:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00010000:00010000:2.0:1790100456.959287:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.959306:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.959324:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.959337:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.959366:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790100456.960684:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1877056126263552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15992us (16359us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1790100456.960695:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:2.0:1790100456.960726:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100456.960857:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.960884:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100456.960892:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.960910:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.960935:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.960943:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d578b4a/0x31a8f3fdeeefde21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100456.960964:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100456.960965:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100456.960967:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790100456.961170:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67bf974380/2, rc 0, transno 4294967322 00000100:00100000:2.0:1790100456.961182:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126263552:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1790100457.006316:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1790100457.006450:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1790100457.006532:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1790100457.006840:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109507200:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 51643us (52151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.006867:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:1.0:1790100457.011271:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100457.011436:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109507584 00000100:00100000:2.0:1790100457.011455:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109507584 00000100:00100000:2.0:1790100457.011653:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 227 00000100:00100000:2.0:1790100457.011669:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:11632:x1877056109507584:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100457.011748:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100457.011786:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f7b expref: 20 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.011820:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:2.0:1790100457.011831:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100457.011888:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.011912:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.011927:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100457.012302:0:6711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b25b09d1 reply state 000000006243c0f3 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.012771:0:6711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100457.012950:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:11632:x1877056109507584:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1285us (1695us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790100457.012958:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 227 00000100:00100000:2.0:1790100457.017772:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:0.0:1790100457.017895:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.017916:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.017927:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.017949:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100457.017954:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.017962:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.017981:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:0.0:1790100457.017985:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790100457.018002:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.018014:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefde2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.018235:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109507712 00000100:00100000:1.0:1790100457.018254:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109507712 00000100:00100000:1.0:1790100457.018344:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1790100457.018360:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678b168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109507712:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790100457.019179:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1790100457.019184:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1790100456 -> 1790100455 00002000:00010000:1.0:1790100457.019187:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790100454 00002000:00010000:1.0:1790100457.019189:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790100456 -> 1790100455 00002000:00010000:1.0:1790100457.019191:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790100457.019325:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678b168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109507712:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 967us (1562us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1790100457.019342:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1790100457.024357:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100457.024482:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109507968 00000100:00100000:2.0:1790100457.024500:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109507968 00000100:00100000:2.0:1790100457.024669:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 228 00000100:00100000:2.0:1790100457.024680:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:11632:x1877056109507968:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790100457.024805:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.024835:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f6d expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.024851:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.025293:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f6d expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.025322:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f6d expref: 20 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.025348:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678b168380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126263936:192.168.201.18@tcp:104: 00000100:00100000:2.0:1790100457.025499:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100457.029444:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100457.029574:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678b168380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126263936:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100457.029658:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.029771:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109508096 00000100:00100000:0.0:1790100457.029780:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109508096 00010000:00010000:0.0:1790100457.029824:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f6d expref: 21 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.029878:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:0.0:1790100457.029889:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:2358:x1877056109508096:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100457.029912:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100457.029924:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f6d expref: 21 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.029937:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f6d expref: 21 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.029979:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefddf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f6d expref: 21 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.030015:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:0.0:1790100457.030025:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.030040:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.030053:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.030086:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100457.030289:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:2358:x1877056109508096:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 398us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.030302:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00010000:00010000:2.0:1790100457.030426:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.030442:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.030487:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.030499:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.030529:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.030540:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100457.030547:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.030560:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.030575:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:2.0:1790100457.030580:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790100457.030586:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.030595:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefde36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.030685:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:11632:x1877056109507968:12345-192.168.201.18@tcp:55:lhsmtool_posix.0 Request processed in 6007us (6346us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790100457.030693:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 228 00000100:00100000:3.0:1790100457.035727:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100457.035886:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109508224 00000100:00100000:2.0:1790100457.035902:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109508224 00000100:00100000:2.0:1790100457.035963:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:2.0:1790100457.035973:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109508224:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790100457.036054:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.036089:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.036135:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790100457.036142:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790100457.036152:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.036215:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.036238:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 8 pid: 6690 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.036262:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf39bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1877056126264064:192.168.201.18@tcp:104: 00000100:00100000:2.0:1790100457.036459:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100457.042050:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100457.042240:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf39bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1877056126264064:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100457.042286:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.042476:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109508352 00000100:00100000:3.0:1790100457.042489:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109508352 00010000:00010000:3.0:1790100457.042550:0:12013:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 9 pid: 6690 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.042604:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:3.0:1790100457.042663:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+9:2358:x1877056109508352:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100457.042679:0:12013:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100457.042704:0:12013:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 9 pid: 6690 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.042717:0:12013:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 9 pid: 6690 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.042911:0:12013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ed8ac09/0x31a8f3fdeeefde1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f89 expref: 9 pid: 6690 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.042932:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100457.042937:0:12013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100457.042943:0:12013:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.042953:0:12013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.042983:0:12013:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100457.043063:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109508352:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 399us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100457.043076:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00010000:00010000:2.0:1790100457.043188:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.043206:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.043245:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.043272:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.043286:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.043296:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100457.043305:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.043320:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.043340:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.043352:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa07b13c/0x31a8f3fdeeefde3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.043427:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2357:x1877056109508224:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 7453us (7708us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.043437:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:3.0:1790100457.047711:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100457.047979:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109508608 00000100:00100000:1.0:1790100457.047994:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109508608 00000100:00100000:1.0:1790100457.048081:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 229 00000100:00100000:1.0:1790100457.048095:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:11632:x1877056109508608:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790100457.048227:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.048253:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.048273:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.048784:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.048803:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f74 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.048844:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.048910:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f74 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.049090:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f74 expref: 20 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100457.049179:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1877056126264192:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100457.049436:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7180 going to sleep for 11 seconds 00000100:00100000:1.0:1790100457.054348:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1877056126264192:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100457.054400:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.057357:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100457.057585:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109508736 00000100:00100000:0.0:1790100457.057603:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109508736 00010000:00010000:0.0:1790100457.057694:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f74 expref: 21 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.057729:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:0.0:1790100457.057749:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:2357:x1877056109508736:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100457.057765:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100457.057778:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f74 expref: 21 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.057834:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f74 expref: 21 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.057881:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefddfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f74 expref: 21 pid: 5843 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.057908:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:0.0:1790100457.057918:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.057930:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.057938:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.057961:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100457.058029:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:2357:x1877056109508736:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 288us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.058038:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 84 00010000:00010000:1.0:1790100457.058549:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.058563:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790100457.058882:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1790100457.059107:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1790100457.059180:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1790100457.059316:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1877056126264320:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790100457.059540:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100457.059592:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100457.059749:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126264320 00000100:00100000:2.0:1790100457.059763:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126264320 00000100:00100000:2.0:1790100457.059846:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100457.059881:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1877056126264320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790100457.059972:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1877056126264320:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.059979:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790100457.060423:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100457.060479:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1790100457.060487:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1790100457.060520:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67bf975f80, transno 4294967321 00000100:00100000:1.0:1790100457.060547:0:5843:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8d67bf974380 x1877056126263552/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790100472 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100457.060567:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1877056126264320:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1790100457.061544:0:5843:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1790100457.061851:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1877056126264448:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790100457.061937:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100457.062253:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100457.064387:0:12069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126264448 00000100:00100000:0.0:1790100457.064413:0:12069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126264448 00000100:00100000:1.0:1790100457.064688:0:12069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790100457.064699:0:12069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5843:x1877056126264448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790100457.065375:0:12069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5843:x1877056126264448:12345-0@lo:1000:mdt00_002.0 Request processed in 671us (3431us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1790100457.065389:0:12069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100457.065520:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1877056126264448:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1790100457.065590:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065608:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065658:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065665:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100457.065670:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065677:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065695:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6799df4100) 00010000:00010000:2.0:1790100457.065698:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100457.065703:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065709:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefde4b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065756:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065781:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065793:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065801:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100457.065807:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065816:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065829:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:2.0:1790100457.065832:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100457.065844:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdd95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f58 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065871:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdd95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f58 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065886:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdd95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f58 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.065938:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdd95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f58 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.065951:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf39bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1877056126264576:192.168.201.18@tcp:105: 00000100:00100000:2.0:1790100457.066066:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d668306c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100457.072126:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100457.072321:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf39bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1877056126264576:192.168.201.18@tcp:105: 00010000:00010000:2.0:1790100457.072373:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072392:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefdd8e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072445:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072468:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072487:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072504:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072515:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072528:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072536:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100457.072543:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072556:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072607:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:2.0:1790100457.072657:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100457.072662:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072668:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefde52 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072679:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072684:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072690:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072694:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100457.072697:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072702:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072710:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:2.0:1790100457.072712:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790100457.072715:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.072720:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefde44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.073186:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:11632:x1877056109508608:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 25087us (25478us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1790100457.073202:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 229 00000020:00080000:2.0:1790100457.073214:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1790100457.073293:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109508864 00000100:00100000:0.0:1790100457.073306:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109508864 00000100:00100000:0.0:1790100457.073381:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 61 00000100:00100000:0.0:1790100457.073395:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:11631:x1877056109508864:12345-192.168.201.18@tcp:49:lfs.0 00000100:00100000:0.0:1790100457.073531:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+24:11631:x1877056109508864:12345-192.168.201.18@tcp:49:lfs.0 Request processed in 138us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.073553:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 61 00000040:00080000:1.0:1790100457.073871:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100457.073881:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790100457.075945:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1790100457.075964:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790100457.082078:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100457.082420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109509376 00000100:00100000:3.0:1790100457.082439:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109509376 00000100:00100000:3.0:1790100457.082526:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 62 00000100:00100000:3.0:1790100457.082543:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67a93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+23:11632:x1877056109509376:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790100457.086363:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100457.086708:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109509120 00000100:00100000:1.0:1790100457.086720:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109509120 00000100:00100000:1.0:1790100457.086802:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 230 00000100:00100000:1.0:1790100457.086821:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+25:11631:x1877056109509120:12345-192.168.201.18@tcp:58:lfs.0 00000040:00080000:1.0:1790100457.087991:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1790100457.088411:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+25:11631:x1877056109509120:12345-192.168.201.18@tcp:58:lfs.0 Request processed in 1585us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100457.088445:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 230 00000004:00080000:2.0:1790100457.089188:0:5844:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790100457.089432:0:5844:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1790100457.089533:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.089670:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.089685:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.089695:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.089702:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.089708:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.089864:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790100457.089979:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67a93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+25:11632:x1877056109509376:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 7438us (7915us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1790100457.090003:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 62 00000020:00080000:2.0:1790100457.090011:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790100457.093376:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100457.093397:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.093418:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143a00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100457.093425:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.093440:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.093471:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d6787def400) 00010000:00010000:1.0:1790100457.093474:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790100457.093484:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.093493:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143a00/0x31a8f3fdeeefde59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100457.093529:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100457.093531:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100457.093532:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100457.149119:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100457.149946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109509504 00000100:00100000:2.0:1790100457.149957:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109509504 00000100:00100000:3.0:1790100457.150330:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 231 00000100:00100000:3.0:1790100457.150349:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+25:11634:x1877056109509504:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100457.150411:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100457.150445:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefde60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f90 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.150551:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.150576:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.150595:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.150646:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.150658:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.150665:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.151367:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.151391:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f51 expref: 26 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.151404:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.151460:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f51 expref: 26 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100457.151497:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f51 expref: 26 pid: 11548 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100457.151522:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787772680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126264704:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100457.153059:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf8189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100457.157747:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100457.157784:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109509760 00000100:00100000:3.0:1790100457.157795:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109509760 00000100:00100000:0.0:1790100457.158241:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:0.0:1790100457.158256:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:5592:x1877056109509760:12345-192.168.201.18@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790100457.158749:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:5592:x1877056109509760:12345-192.168.201.18@tcp:35:ldlm_bl.0 Request processed in 494us (1010us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1790100457.158851:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 63 00000100:00100000:2.0:1790100457.159469:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787772680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1877056126264704:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100457.159511:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100457.163932:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100457.164256:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109509888 00000100:00100000:0.0:1790100457.164272:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109509888 00010000:00010000:0.0:1790100457.164344:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f51 expref: 28 pid: 11548 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100457.164408:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:0.0:1790100457.164424:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:2358:x1877056109509888:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100457.164450:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100457.164462:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f51 expref: 28 pid: 11548 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.164483:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f51 expref: 28 pid: 11548 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.164517:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819200/0x31a8f3fdeeefdd80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f51 expref: 28 pid: 11548 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.164574:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:0.0:1790100457.164586:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.164603:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.164816:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100457.164868:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100457.164950:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+27:2358:x1877056109509888:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 528us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100457.164962:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00010000:00010000:2.0:1790100457.165112:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165126:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100457.165199:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790100457.165206:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100457.165239:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165261:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165276:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165285:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165297:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165308:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aea00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100457.165315:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165342:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165358:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:2.0:1790100457.165363:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100457.165369:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165379:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aea00/0x31a8f3fdeeefde67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165399:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165411:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165419:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165427:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100457.165433:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165441:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165454:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d6787ec1c00) 00010000:00010000:2.0:1790100457.165456:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100457.165462:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165487:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af000/0x31a8f3fdeeefde6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165545:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af600/0x31a8f3fdeeefde60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f90 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165566:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f90 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100457.165579:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:2.0:1790100457.165581:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100457.165586:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae400, rc 0) 00000100:00100000:2.0:1790100457.165668:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:11634:x1877056109509504:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 15324us (16571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100457.165675:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 231 00010000:00010000:3.0:1790100457.830093:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100458.085931:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100458.085943:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790100458.086000:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790100458.086007:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790100458.086280:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812a9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126264832:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790100458.086450:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784fe70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100458.120598:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812a9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11684:1877056126264832:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790100458.140542:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100458.140762:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109510016 00000100:00100000:2.0:1790100458.140772:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109510016 00000100:00100000:3.0:1790100458.141029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00100000:3.0:1790100458.141041:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:11645:x1877056109510016:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790100458.141097:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790100458.141200:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:11645:x1877056109510016:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 161us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100458.141208:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 232 00000100:00080000:1.0:1790100458.141345:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100458.146472:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100458.146597:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109510272 00000100:00100000:1.0:1790100458.146688:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109510272 00000100:00100000:1.0:1790100458.146745:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 233 00000100:00100000:1.0:1790100458.146754:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+26:11645:x1877056109510272:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100458.146774:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100458.146793:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefde7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f97 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.146901:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefde83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.146915:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefde83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.146925:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefde83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100458.146935:0:6711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790100458.147049:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefde7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f97 expref: 29 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.147066:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefde83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f97 expref: 28 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.147074:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:1.0:1790100458.147077:0:6711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100458.147080:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13000, rc 0) 00000100:00100000:1.0:1790100458.147181:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:11645:x1877056109510272:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 427us (718us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1790100458.147204:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 233 00000100:00100000:2.0:1790100458.161315:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100458.161432:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109510528 00000100:00100000:3.0:1790100458.161443:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109510528 00000100:00100000:3.0:1790100458.161558:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 234 00000100:00100000:3.0:1790100458.161571:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:11645:x1877056109510528:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790100458.161711:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100458.161730:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100458.161778:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100458.161976:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100458.161985:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100458.161992:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100458.161999:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100458.162004:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100458.162012:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100458.162026:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:3.0:1790100458.162029:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790100458.162034:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100458.162042:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af400/0x31a8f3fdeeefde91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100458.162199:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:11645:x1877056109510528:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 630us (896us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1790100458.162208:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 234 00000040:00080000:1.0:1790100458.162378:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790100458.162383:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790100458.163507:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790100458.163519:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100458.164232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100458.164370:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109510656 00000100:00100000:0.0:1790100458.164382:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109510656 00000100:00100000:0.0:1790100458.164455:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:0.0:1790100458.164468:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:2358:x1877056109510656:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100458.164486:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100458.164513:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13000/0x31a8f3fdeeefde83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f97 expref: 29 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100458.164532:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:0.0:1790100458.164539:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100458.164601:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:2358:x1877056109510656:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 136us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100458.164632:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:2.0:1790100458.170044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100458.170194:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109510912 00000100:00100000:3.0:1790100458.170207:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109510912 00000100:00100000:3.0:1790100458.170275:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 64 00000100:00100000:3.0:1790100458.170285:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+28:11645:x1877056109510912:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790100458.170567:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:11645:x1877056109510912:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 283us (533us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790100458.170577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 64 00000040:00080000:0.0:1790100458.352506:0:12573:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790100458.352515:0:12573:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790100458.352555:0:12573:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790100458.352562:0:12573:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790100458.760082:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100458.760180:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109511168 00000100:00100000:1.0:1790100458.760192:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109511168 00000100:00100000:1.0:1790100458.760252:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 235 00000100:00100000:1.0:1790100458.760266:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b58e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+29:11658:x1877056109511168:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100458.760291:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100458.760313:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefde98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64f9e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.760417:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefde9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.760433:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefde9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.760447:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefde9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100458.760458:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790100458.760592:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12600/0x31a8f3fdeeefde98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f9e expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.760630:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefde9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f9e expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.760653:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:1.0:1790100458.760656:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790100458.760660:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12000, rc 0) 00000100:00100000:1.0:1790100458.760707:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b58e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:11658:x1877056109511168:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 446us (637us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790100458.760713:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 235 00000100:00100000:2.0:1790100458.773443:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100458.774170:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109511296 00000100:00100000:1.0:1790100458.774182:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109511296 00000100:00100000:1.0:1790100458.774245:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 236 00000100:00100000:1.0:1790100458.774257:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:11658:x1877056109511296:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:1.0:1790100458.774348:0:11548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.774366:0:11548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.774379:0:11548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.774407:0:11548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.774414:0:11548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.774421:0:11548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.774428:0:11548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100458.774443:0:11548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.774452:0:11548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.774465:0:11548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:1.0:1790100458.774468:0:11548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100458.774473:0:11548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100458.774480:0:11548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefdead lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100458.775184:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:11658:x1877056109511296:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 925us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100458.775194:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 236 00010000:00010000:1.0:1790100458.859365:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100459.042519:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100459.042661:0:12004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109511424 00000100:00100000:3.0:1790100459.042672:0:12004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109511424 00000100:00080000:1.0:1790100459.042855:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100459.042960:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:3.0:1790100459.042972:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109511424:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:3.0:1790100459.042991:0:12004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100459.043021:0:12004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d93417b/0x31a8f3fdeeefdeb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64fa5 expref: -99 pid: 12004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100459.043046:0:12004:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6ab2c3e7, atime: 0x6ab2c3e6, ctime: 0x6ab2c3e7, blocks: 0xb 00010000:00010000:3.0:1790100459.043073:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1790100459.043077:0:12004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100459.043085:0:12004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d93417b/0x31a8f3fdeeefdeb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fa5 expref: 8 pid: 12004 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100459.043099:0:12004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d93417b/0x31a8f3fdeeefdeb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fa5 expref: 8 pid: 12004 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100459.043111:0:12004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900ae000, rc 0) 00000100:00100000:3.0:1790100459.043162:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2358:x1877056109511424:12345-192.168.201.18@tcp:101:cat.0 Request processed in 194us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100459.043181:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 71 00000100:00100000:0.0:1790100459.084217:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100459.084741:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109511552 00000100:00100000:3.0:1790100459.084754:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109511552 00002000:00100000:3.0:1790100459.084813:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8d67bb9f1500 x1877056109511552/t0(0) o3->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:0/0 lens 488/0 e 0 to 0 dl 1790100470 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790100459.084836:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bb9f1500 with x1877056109511552 ext(0->4095) 00002000:00010000:3.0:1790100459.084843:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bb9f1500 00000100:00100000:3.0:1790100459.084879:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:3.0:1790100459.084888:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109511552:12345-192.168.201.18@tcp:3:cat.0 00000100:00100000:3.0:1790100459.085796:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2357:x1877056109511552:12345-192.168.201.18@tcp:3:cat.0 Request processed in 903us (1581us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790100459.085806:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00002000:00100000:3.0:1790100459.085814:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8d67bb9f1500 x1877056109511552/t0(0) o3->dd2cd87b-6ca1-4323-9b74-fad785d94e6c@192.168.201.18@tcp:0/0 lens 488/4536 e 0 to 0 dl 1790100470 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790100459.085822:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d67bb9f1500 with x1877056109511552 ext(0->4095) 00002000:00010000:3.0:1790100459.085836:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d67bb9f1500 00000001:00080000:3.0:1790100459.403905:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1790100459.403927:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:3.0:1790100459.881062:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100460.302015:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100460.302051:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100460.302074:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100460.302100:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100460.302117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100460.302150:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109511936 00000100:00100000:2.0:1790100460.302161:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109511936 00000100:00100000:2.0:1790100460.302223:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109512064 00000100:00100000:2.0:1790100460.302226:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109512064 00000100:00100000:2.0:1790100460.302243:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:2.0:1790100460.302252:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2360:x1877056109511936:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100460.302338:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2360:x1877056109511936:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100460.302345:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:2.0:1790100460.302360:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:2.0:1790100460.302366:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2360:x1877056109512064:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100460.302388:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+8:2360:x1877056109512064:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 23us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100460.302394:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 70 00000100:00100000:2.0:1790100460.302422:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109512192 00000100:00100000:2.0:1790100460.302425:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109512192 00000100:00100000:2.0:1790100460.302446:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109511808 00000100:00100000:2.0:1790100460.302448:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109511808 00000100:00100000:2.0:1790100460.302465:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 143 00000100:00100000:2.0:1790100460.302470:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2360:x1877056109512192:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100460.302493:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2360:x1877056109512192:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 23us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100460.302499:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 143 00000100:00100000:2.0:1790100460.302508:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00100000:2.0:1790100460.302519:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:2360:x1877056109511808:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100460.302925:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+31:2360:x1877056109511808:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 405us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100460.302933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 144 00000100:00080000:2.0:1790100460.302952:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100460.302956:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100460.305651:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109511680 00000100:00100000:3.0:1790100460.305665:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109511680 00000100:00100000:3.0:1790100460.305734:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 291 00000100:00100000:3.0:1790100460.305752:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2360:x1877056109511680:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100460.305838:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2360:x1877056109511680:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 88us (3841us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100460.305853:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 291 00000100:00100000:1.0:1790100460.775636:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100460.775668:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126264960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100460.775762:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100460.775901:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126264960 00000100:00100000:3.0:1790100460.775913:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126264960 00000100:00100000:3.0:1790100460.776167:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790100460.776180:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877056126264960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100460.776230:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100460.776289:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877056126264960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100460.776297:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790100460.776350:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126264960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100460.776982:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126265472:0@lo:400:kworker.0 00000100:00100000:0.0:1790100460.777029:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100460.777183:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790100460.777189:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126265088:0@lo:400:kworker.0 00000100:00100000:0.0:1790100460.777223:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100460.777244:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126265600:0@lo:400:kworker.0 00000100:00100000:0.0:1790100460.777274:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100460.777739:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126265344:0@lo:400:kworker.0 00000100:00100000:3.0:1790100460.777778:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100460.777819:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100460.777826:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126265216:0@lo:400:kworker.0 00000100:00100000:3.0:1790100460.777849:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100460.777945:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126265600 00000100:00100000:3.0:1790100460.777953:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126265600 00000100:00100000:2.0:1790100460.778253:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126265472 00000100:00100000:2.0:1790100460.778259:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126265472 00000100:00080000:1.0:1790100460.778314:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790100460.778320:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790100460.778322:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100460.778336:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126265344 00000100:00100000:1.0:1790100460.778340:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126265344 00000100:00100000:1.0:1790100460.778387:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126265216 00000100:00100000:1.0:1790100460.778390:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126265216 00000100:00100000:1.0:1790100460.778411:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790100460.778419:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126265344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100460.778498:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126265344:12345-0@lo:400:kworker.0 Request processed in 79us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100460.778506:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790100460.778522:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790100460.778529:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126265216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100460.778555:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126265216:12345-0@lo:400:kworker.0 Request processed in 27us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100460.778561:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1790100460.778579:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100460.778829:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790100460.778836:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126265600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100460.778879:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126265600:12345-0@lo:400:kworker.0 Request processed in 43us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100460.778885:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790100460.779027:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126265216:0@lo:400:kworker.0 00000100:00100000:3.0:1790100460.779103:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126265344:0@lo:400:kworker.0 00000100:00100000:3.0:1790100460.779198:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126265600:0@lo:400:kworker.0 00000100:00100000:2.0:1790100460.779371:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790100460.779380:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126265472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100460.779437:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126265472:12345-0@lo:400:kworker.0 Request processed in 59us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100460.779444:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790100460.779470:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126265088 00000100:00100000:2.0:1790100460.779476:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126265088 00000100:00100000:2.0:1790100460.779504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1790100460.779511:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126265088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100460.779542:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126265088:12345-0@lo:400:kworker.0 Request processed in 32us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100460.779548:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1790100460.779831:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126265088:0@lo:400:kworker.0 00000100:00100000:0.0:1790100460.779844:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1790100460.779850:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1790100460.779873:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67bb9f0380, transno 4294967310 00000100:00100000:0.0:1790100460.779885:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126265472:0@lo:400:kworker.0 00010000:00010000:1.0:1790100460.901909:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100461.798649:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100461.798681:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126265728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100461.798776:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100461.799512:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126265728 00000100:00100000:2.0:1790100461.799523:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126265728 00000100:00100000:2.0:1790100461.799593:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790100461.799605:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126265728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100461.799687:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100461.799760:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126265728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100461.799794:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790100461.799908:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126265728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100461.925912:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790100462.459626:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1790100462.459646:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1790100462.478394:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:2.0:1790100462.478411:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1790100462.478523:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:0.0:1790100462.478537:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1790100462.478729:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1790100462.481579:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d6788dc7f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1790100462.481591:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ae5fd900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d6788dc7cc0 00000020:00080000:2.0:1790100462.481596:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d67ae5fda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d678776ac00 00000020:00080000:3.0:1790100462.482583:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1790100462.482866:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1790100462.952174:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100463.974485:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100464.998897:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100465.206492:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100465.206546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100465.206585:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100465.206647:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100465.206676:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100465.206709:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109512832 00000100:00100000:2.0:1790100465.206719:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109512832 00000100:00100000:3.0:1790100465.206821:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109512576 00000100:00100000:3.0:1790100465.206827:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109512576 00000100:00100000:3.0:1790100465.206877:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109512704 00000100:00100000:3.0:1790100465.206881:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109512704 00000100:00100000:3.0:1790100465.206907:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:3.0:1790100465.206917:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109512576:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100465.207004:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2358:x1877056109512576:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 88us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100465.207012:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:3.0:1790100465.207029:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:3.0:1790100465.207037:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109512704:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100465.207072:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2358:x1877056109512704:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 35us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100465.207079:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:1.0:1790100465.207730:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109512320 00000100:00100000:1.0:1790100465.207747:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109512320 00000100:00100000:1.0:1790100465.207784:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 293 00000100:00100000:1.0:1790100465.207792:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109512320:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100465.207834:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109512320:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 43us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100465.207841:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 293 00000100:00080000:1.0:1790100465.207870:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790100465.207874:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100465.209575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109512448 00000100:00100000:2.0:1790100465.209587:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109512448 00000100:00100000:2.0:1790100465.209633:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00100000:2.0:1790100465.209643:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109512832:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100465.209708:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2358:x1877056109512832:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 67us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100465.209715:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 148 00000100:00100000:2.0:1790100465.209757:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 149 00000100:00100000:2.0:1790100465.209764:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:2358:x1877056109512448:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100465.209805:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:2358:x1877056109512448:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 42us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100465.209812:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 149 00000100:00080000:1.0:1790100465.210735:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100465.893849:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126265856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100465.893922:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100465.894201:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126265856 00000100:00100000:3.0:1790100465.894210:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126265856 00000100:00100000:3.0:1790100465.894276:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790100465.894287:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126265856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100465.894341:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100465.894394:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126265856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100465.894401:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790100465.894440:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1790100465.894444:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67bf974380, transno 4294967322 00000004:00080000:3.0:1790100465.894453:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1790100465.894479:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126265856:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790100465.895177:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100465.895292:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126266240:0@lo:400:kworker.0 00000100:00100000:2.0:1790100465.895335:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100465.895363:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100465.895369:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126266368:0@lo:400:kworker.0 00000100:00100000:2.0:1790100465.895395:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100465.895428:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126266240 00000100:00100000:2.0:1790100465.895433:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126266240 00000100:00100000:2.0:1790100465.895469:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1790100465.895475:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126266240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100465.895510:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126266240:12345-0@lo:400:kworker.0 Request processed in 35us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100465.895516:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1790100465.895529:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100465.895546:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126266240:0@lo:400:kworker.0 00000100:00100000:0.0:1790100465.895587:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126265984:0@lo:400:kworker.0 00000100:00100000:0.0:1790100465.895640:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100465.895662:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126266496:0@lo:400:kworker.0 00000100:00100000:0.0:1790100465.895691:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100465.895704:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100465.895719:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126266112:0@lo:400:kworker.0 00000100:00100000:0.0:1790100465.895745:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100465.896213:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126266368 00000100:00100000:3.0:1790100465.896218:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126266368 00000100:00100000:3.0:1790100465.896263:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790100465.896270:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126266368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100465.896309:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126266368:12345-0@lo:400:kworker.0 Request processed in 40us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100465.896316:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790100465.896385:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126265984 00000100:00100000:2.0:1790100465.896389:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126265984 00000100:00100000:2.0:1790100465.896421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1790100465.896426:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126265984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100465.896457:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126265984:12345-0@lo:400:kworker.0 Request processed in 31us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100465.896463:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1790100465.896484:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126266496 00000100:00100000:2.0:1790100465.896493:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126266496 00000100:00100000:2.0:1790100465.896511:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126266112 00000100:00100000:2.0:1790100465.896513:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126266112 00000100:00100000:2.0:1790100465.896525:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790100465.896529:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126266496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100465.896553:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126266496:12345-0@lo:400:kworker.0 Request processed in 24us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100465.896558:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790100465.896567:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790100465.896571:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126266112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100465.896589:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126266112:12345-0@lo:400:kworker.0 Request processed in 18us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100465.896593:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790100465.896637:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126266368:0@lo:400:kworker.0 00000100:00100000:2.0:1790100465.896656:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126266112:0@lo:400:kworker.0 00000100:00100000:2.0:1790100465.896663:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126265984:0@lo:400:kworker.0 00000100:00100000:2.0:1790100465.896670:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126266496:0@lo:400:kworker.0 00000100:00080000:0.0:1790100465.896752:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100465.896756:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790100466.227013:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100466.925670:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126266624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100466.925753:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100466.925838:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126266624 00000100:00100000:1.0:1790100466.925852:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126266624 00000100:00100000:1.0:1790100466.925896:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790100466.925904:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126266624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100466.925949:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100466.925988:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126266624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100466.925996:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790100466.926041:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126266624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100467.250399:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790100467.536738:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1790100467.536771:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1790100467.536781:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1790100468.263470:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100468.391288:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790100468.391299:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100468.392162:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1790100468.392171:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790100469.286021:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100469.289019:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100469.291945:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109512960 00000100:00100000:2.0:1790100469.291962:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109512960 00000100:00100000:2.0:1790100469.292047:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 237 00000100:00100000:2.0:1790100469.292060:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:11319:x1877056109512960:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790100469.292197:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:11319:x1877056109512960:12345-192.168.201.18@tcp:60:lhsmtool_posix.0 Request processed in 134us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100469.292221:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 237 00000100:00080000:1.0:1790100469.292422:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100469.412440:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100469.412703:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109513216 00000100:00100000:0.0:1790100469.412715:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109513216 00000100:00100000:0.0:1790100469.412776:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 65 00000100:00100000:0.0:1790100469.412787:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:11319:x1877056109513216:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790100469.413143:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:11319:x1877056109513216:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 356us (711us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1790100469.413161:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 65 00010000:00010000:0.0:1790100470.310316:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100470.328706:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100470.328748:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100470.328776:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100470.328810:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100470.328838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100470.328867:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109513856 00000100:00100000:2.0:1790100470.328878:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109513856 00000100:00100000:2.0:1790100470.328938:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109513472 00000100:00100000:2.0:1790100470.328942:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109513472 00000100:00100000:2.0:1790100470.328964:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 153 00000100:00100000:2.0:1790100470.328973:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109513856:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100470.329049:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d25abe39-6b64-46c4-a568-4506410538f0+5:2357:x1877056109513856:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 77us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.329057:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 153 00000100:00100000:2.0:1790100470.329075:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 154 00000100:00100000:2.0:1790100470.329081:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:2357:x1877056109513472:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100470.329111:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:2357:x1877056109513472:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 30us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100470.329117:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 154 00000100:00080000:2.0:1790100470.329367:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100470.329443:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109513600 00000100:00100000:0.0:1790100470.329448:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109513600 00000100:00100000:0.0:1790100470.329490:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109513728 00000100:00100000:0.0:1790100470.329494:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109513728 00000100:00100000:0.0:1790100470.329513:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:0.0:1790100470.329521:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109513600:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100470.329559:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2357:x1877056109513600:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 39us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100470.329566:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 75 00000100:00100000:0.0:1790100470.329580:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:0.0:1790100470.329586:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2357:x1877056109513728:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100470.329672:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2357:x1877056109513728:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 86us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100470.329680:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 76 00000100:00100000:3.0:1790100470.330771:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109513344 00000100:00100000:3.0:1790100470.330780:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109513344 00000100:00100000:3.0:1790100470.330868:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 295 00000100:00100000:3.0:1790100470.330882:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109513344:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100470.330957:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109513344:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 81us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100470.330964:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 295 00000100:00080000:2.0:1790100470.331480:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100470.331484:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100471.016335:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126266752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100471.016435:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100471.017249:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126266752 00000100:00100000:1.0:1790100471.017260:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126266752 00000100:00100000:1.0:1790100471.017326:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790100471.017335:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126266752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100471.017371:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100471.017435:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126266752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100471.017442:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790100471.017689:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126266752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100471.017765:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126267008:0@lo:400:kworker.0 00000100:00100000:1.0:1790100471.017794:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100471.017812:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100471.017817:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126267136:0@lo:400:kworker.0 00000100:00100000:1.0:1790100471.017834:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100471.017855:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126267264:0@lo:400:kworker.0 00000100:00100000:1.0:1790100471.017877:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100471.017908:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790100471.017913:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126266880:0@lo:400:kworker.0 00000100:00100000:1.0:1790100471.017936:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100471.017961:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126267392:0@lo:400:kworker.0 00000100:00100000:1.0:1790100471.017978:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100471.017997:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126267264 00000100:00100000:1.0:1790100471.018001:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126267264 00000100:00100000:1.0:1790100471.018029:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790100471.018034:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126267264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100471.018066:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126267264:12345-0@lo:400:kworker.0 Request processed in 31us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100471.018072:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790100471.018489:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126267264:0@lo:400:kworker.0 00000100:00080000:2.0:1790100471.020296:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100471.020305:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790100471.020323:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126267008 00000100:00100000:2.0:1790100471.020332:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126267008 00000100:00100000:2.0:1790100471.020388:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126267136 00000100:00100000:2.0:1790100471.020391:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126267136 00000100:00100000:2.0:1790100471.020425:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126267392 00000100:00100000:2.0:1790100471.020428:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126267392 00000100:00100000:2.0:1790100471.020444:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790100471.020451:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126267008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100471.020539:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126267008:12345-0@lo:400:kworker.0 Request processed in 89us (2744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100471.020546:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790100471.020561:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790100471.020567:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126267136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100471.020590:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126267136:12345-0@lo:400:kworker.0 Request processed in 24us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100471.020596:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790100471.020604:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790100471.020857:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126267392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100471.020895:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126267392:12345-0@lo:400:kworker.0 Request processed in 286us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100471.020902:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1790100471.020928:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100471.020956:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126267136:0@lo:400:kworker.0 00000100:00100000:2.0:1790100471.020966:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126267008:0@lo:400:kworker.0 00000100:00100000:2.0:1790100471.021009:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126267392:0@lo:400:kworker.0 00000100:00100000:2.0:1790100471.021039:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126266880 00000100:00100000:2.0:1790100471.021042:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126266880 00000100:00100000:2.0:1790100471.021067:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1790100471.021073:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126266880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100471.021104:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126266880:12345-0@lo:400:kworker.0 Request processed in 31us (3167us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100471.021110:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1790100471.021308:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126266880:0@lo:400:kworker.0 00010000:00010000:3.0:1790100471.334537:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100472.038083:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100472.038110:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126267520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100472.038181:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100472.038365:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126267520 00000100:00100000:1.0:1790100472.038375:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126267520 00000100:00100000:1.0:1790100472.038443:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790100472.038454:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126267520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100472.038492:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100472.038543:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126267520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100472.038550:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790100472.038597:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126267520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100472.358008:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790100472.695672:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000001:02000400:1.0:1790100473.267099:0:12779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:07:50 (1790100470) 00010000:00010000:3.0:1790100473.385424:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100474.407641:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100475.430956:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100475.443468:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100475.443521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100475.443647:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109513984 00000100:00100000:0.0:1790100475.443659:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109513984 00000100:00100000:0.0:1790100475.443720:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 297 00000100:00100000:0.0:1790100475.443731:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109513984:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100475.443830:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2358:x1877056109513984:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 100us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100475.443839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 297 00000100:00100000:3.0:1790100475.444292:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109514112 00000100:00100000:3.0:1790100475.444299:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109514112 00000100:00100000:3.0:1790100475.444378:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 158 00000100:00100000:3.0:1790100475.444397:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:2358:x1877056109514112:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100475.444450:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:2358:x1877056109514112:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 55us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100475.444457:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 158 00000100:00080000:0.0:1790100475.444750:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100475.494285:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100475.494447:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100475.494479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100475.494560:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109514496 00000100:00100000:0.0:1790100475.494572:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109514496 00000100:00100000:0.0:1790100475.494692:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 159 00000100:00100000:0.0:1790100475.494705:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109514496:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100475.494811:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+5:2359:x1877056109514496:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 108us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100475.494819:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 159 00000100:00100000:3.0:1790100475.495526:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109514368 00000100:00100000:3.0:1790100475.495537:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109514368 00000100:00100000:3.0:1790100475.495604:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109514240 00000100:00100000:3.0:1790100475.495635:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109514240 00000100:00100000:3.0:1790100475.495667:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:3.0:1790100475.495747:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2359:x1877056109514368:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100475.495856:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2359:x1877056109514368:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 181us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100475.495864:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:3.0:1790100475.495883:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:3.0:1790100475.495960:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2356:x1877056109514240:12345-192.168.201.18@tcp:9:kworker.0 00000020:00000080:3.0:1790100475.495985:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefd220 00000100:00080000:3.0:1790100475.496011:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8d67b5a27000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790100475.496061:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1790100475.496588:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100475.496593:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100475.496597:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790100475.498584:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100475.499444:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+2:2356:x1877056109514240:12345-192.168.201.18@tcp:9:kworker.0 Request processed in 3475us (4952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100475.499459:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 72 00000100:00100000:1.0:1790100476.137099:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67852cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126267648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100476.137200:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100476.137305:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126267648 00000100:00100000:1.0:1790100476.137315:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126267648 00000100:00100000:1.0:1790100476.137400:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790100476.137411:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126267648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100476.137458:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100476.137508:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126267648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100476.137516:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790100476.137585:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67852cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126267648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100476.138221:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126267776:0@lo:400:kworker.0 00000100:00100000:3.0:1790100476.138268:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100476.138300:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126268288:0@lo:400:kworker.0 00000100:00100000:3.0:1790100476.138329:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100476.138406:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790100476.138412:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126267904:0@lo:400:kworker.0 00000100:00100000:3.0:1790100476.138439:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100476.138473:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126267776 00000100:00100000:3.0:1790100476.138480:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126267776 00000100:00100000:3.0:1790100476.138520:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1790100476.138528:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126267776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100476.138584:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126267776:12345-0@lo:400:kworker.0 Request processed in 57us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100476.138592:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1790100476.138648:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126268288 00000100:00100000:3.0:1790100476.138653:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126268288 00000100:00100000:3.0:1790100476.138688:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126267904 00000100:00100000:3.0:1790100476.138691:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126267904 00000100:00100000:3.0:1790100476.138712:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790100476.138720:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126268288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100476.138755:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126268288:12345-0@lo:400:kworker.0 Request processed in 36us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100476.142523:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790100476.142595:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790100476.142629:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126267904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100476.142756:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126267904:12345-0@lo:400:kworker.0 Request processed in 152us (4316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100476.142763:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1790100476.143778:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790100476.143790:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100476.144039:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126268160:0@lo:400:kworker.0 00000100:00100000:1.0:1790100476.144120:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100476.144172:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790100476.144181:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126268032:0@lo:400:kworker.0 00000100:00100000:1.0:1790100476.144209:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100476.144246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126268032 00000100:00100000:1.0:1790100476.144255:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126268032 00000100:00100000:0.0:1790100476.144296:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126268160 00000100:00100000:0.0:1790100476.144309:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126268160 00000100:00100000:1.0:1790100476.144361:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790100476.144376:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126268032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100476.144397:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790100476.144411:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67852cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126268160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100476.144444:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126268032:12345-0@lo:400:kworker.0 Request processed in 71us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100476.144453:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790100476.144511:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126268032:0@lo:400:kworker.0 00000100:00100000:1.0:1790100476.144528:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126268160:0@lo:400:kworker.0 00000100:00100000:0.0:1790100476.144545:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67852cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126268160:12345-0@lo:400:kworker.0 Request processed in 127us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100476.144555:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790100476.144940:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126267904:0@lo:400:kworker.0 00000100:00100000:3.0:1790100476.144955:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126267776:0@lo:400:kworker.0 00000100:00100000:3.0:1790100476.144967:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126268288:0@lo:400:kworker.0 00000100:00080000:0.0:1790100476.145319:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790100476.145328:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790100476.454889:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100477.159431:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126268416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100477.159556:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100477.161540:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126268416 00000100:00100000:0.0:1790100477.161563:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126268416 00000100:00100000:0.0:1790100477.161683:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790100477.161696:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126268416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100477.161752:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100477.162000:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126268416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (2443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100477.162009:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790100477.162392:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126268416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790100477.478947:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100478.134061:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100478.134346:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109514624 00000100:00100000:1.0:1790100478.134358:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109514624 00000100:00100000:1.0:1790100478.134437:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 238 00000100:00100000:1.0:1790100478.134449:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:12323:x1877056109514624:12345-192.168.201.18@tcp:101:lsof.0 00010000:00010000:1.0:1790100478.134471:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100478.134493:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefdebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64fac expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100478.134593:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdec2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100478.134656:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100478.134671:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100478.134712:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790100478.134716:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100478.134756:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100478.134781:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12800/0x31a8f3fdeeefdebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fac expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100478.134800:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fac expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100478.134809:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:1.0:1790100478.134812:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100478.134833:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12a00, rc 0) 00000100:00100000:1.0:1790100478.134894:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+6:12323:x1877056109514624:12345-192.168.201.18@tcp:101:lsof.0 Request processed in 447us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100478.134902:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 238 00000100:00080000:2.0:1790100478.135213:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790100478.502032:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100478.630098:0:11684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790100478.630113:0:11684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790100478.630471:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1790100478.630479:0:11684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790100479.525770:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790100479.875424:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:0.0:1790100479.875434:0:6714:0:(genops.c:885:class_export_put()) final put ffff8d67b5a26000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:1.0:1790100479.875531:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67b5a26000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c for lustre-OST0000 00000020:00000080:1.0:1790100479.875588:0:487:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67b5a27000 for lustre-OST0000 00000100:00100000:0.0:1790100479.933828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100479.936047:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109514880 00000100:00100000:3.0:1790100479.936065:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109514880 00000100:00100000:3.0:1790100479.936156:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00100000:3.0:1790100479.936168:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+18:12324:x1877056109514880:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:3.0:1790100479.936962:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:12324:x1877056109514880:12345-192.168.201.18@tcp:35:umount.0 Request processed in 793us (3141us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1790100479.936972:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 66 00000100:00080000:2.0:1790100479.937304:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100479.952550:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100479.955667:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109515136 00000100:00100000:1.0:1790100479.955685:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109515136 00000100:00100000:1.0:1790100479.955761:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:1.0:1790100479.955773:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+19:12324:x1877056109515136:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:1.0:1790100479.958691:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:12324:x1877056109515136:12345-192.168.201.18@tcp:35:umount.0 Request processed in 2907us (6137us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1790100479.958705:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 67 00000100:00100000:0.0:1790100479.981855:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100479.981946:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109515392 00000100:00100000:1.0:1790100479.981958:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109515392 00000100:00100000:1.0:1790100479.982021:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:1.0:1790100479.982034:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67a93f4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+20:12324:x1877056109515392:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:1.0:1790100479.982822:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67a93f4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:12324:x1877056109515392:12345-192.168.201.18@tcp:35:umount.0 Request processed in 786us (972us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1790100479.982832:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 68 00000100:00100000:0.0:1790100479.994207:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100479.994519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109515648 00000100:00100000:1.0:1790100479.994530:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109515648 00000100:00100000:1.0:1790100479.994591:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:1.0:1790100479.994602:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:12324:x1877056109515648:12345-192.168.201.18@tcp:35:umount.0 00000100:00100000:1.0:1790100479.995026:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:12324:x1877056109515648:12345-192.168.201.18@tcp:35:umount.0 Request processed in 424us (839us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1790100479.995046:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 69 00000100:00100000:0.0:1790100480.075832:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100480.075884:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100480.075920:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100480.076019:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100480.076084:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109516288 00000100:00100000:1.0:1790100480.076104:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109516288 00000100:00100000:1.0:1790100480.076178:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00100000:1.0:1790100480.076190:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+7:2356:x1877056109516288:12345-192.168.201.18@tcp:9:umount.0 00000020:00000080:1.0:1790100480.076237:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefd481 00000020:00010000:1.0:1790100480.076247:0:6687:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d6799d92000: total 0 00000100:00080000:1.0:1790100480.076253:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d6799d94000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100480.076299:0:6687:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790100480.076582:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+5:2356:x1877056109516288:12345-192.168.201.18@tcp:9:umount.0 Request processed in 393us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100480.076591:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 73 00000100:00080000:1.0:1790100480.092674:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100480.109126:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109515776 00000100:00100000:3.0:1790100480.109146:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109515776 00000100:00100000:3.0:1790100480.109240:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109516032 00000100:00100000:3.0:1790100480.109244:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109516032 00000100:00100000:3.0:1790100480.109287:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109516416 00000100:00100000:3.0:1790100480.109292:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109516416 00000100:00100000:3.0:1790100480.109317:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1790100480.109327:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+15:2358:x1877056109515776:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100480.109344:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100480.109365:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781523e00/0x31a8f3fdeeefceae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b06 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.109385:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100480.109454:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+14:2358:x1877056109515776:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 128us (33632us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100480.109461:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1790100480.109518:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:3.0:1790100480.109525:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+13:2357:x1877056109516032:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100480.109533:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100480.109541:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67ad819600/0x31a8f3fdeeefd132 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c09 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.109550:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100480.109566:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:2357:x1877056109516032:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 42us (33646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100480.109572:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:3.0:1790100480.109584:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1790100480.109589:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:2360:x1877056109516416:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100480.109596:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100480.109603:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf531c00/0x31a8f3fdeeefcf48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b3e expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.109659:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100480.109680:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109516416:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 90us (33660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100480.109687:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000020:00010000:3.0:1790100480.109714:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d6799d92000: total 0 00010000:00010000:3.0:1790100480.109759:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d6799d92000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1790100480.109804:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d93417b/0x31a8f3fdeeefdeb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fa5 expref: 4 pid: 12004 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.109835:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefd824 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dde expref: 3 pid: 12004 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.109851:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d6799d92000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1790100480.109864:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100480.109866:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100480.109868:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100480.109928:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100480.110061:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109517440 00000100:00100000:3.0:1790100480.110065:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109517440 00000100:00100000:3.0:1790100480.110093:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 239 00000100:00100000:3.0:1790100480.110099:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+22:2356:x1877056109517440:12345-192.168.201.18@tcp:39:umount.0 00000020:00000080:3.0:1790100480.110126:0:11548:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcebc 00000020:00010000:3.0:1790100480.110142:0:11548:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d67bf540000: total 0 00000100:00080000:3.0:1790100480.110147:0:11548:0:(import.c:65:import_set_state_nolock()) ffff8d67b5cd0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790100480.110172:0:11548:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1790100480.110597:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cd87b-6ca1-4323-9b74-fad785d94e6c+21:2356:x1877056109517440:12345-192.168.201.18@tcp:39:umount.0 Request processed in 496us (667us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1790100480.110640:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 239 00000020:00010000:3.0:1790100480.110659:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d67bf540000: total 0 00010000:00010000:3.0:1790100480.110662:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100480.110683:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d67bf540000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1790100480.110706:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100480.110709:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790100480.110715:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae200/0x31a8f3fdeeefd894 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dfa expref: 20 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110733:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def300) 00010000:00010000:3.0:1790100480.110735:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100480.110739:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142e00/0x31a8f3fdeeefd1a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c1e expref: 19 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110755:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d6787ec1200) 00010000:00010000:3.0:1790100480.110757:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100480.110760:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefdb73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ecc expref: 18 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110777:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:3.0:1790100480.110779:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100480.110782:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900af800/0x31a8f3fdeeefdd95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f58 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110793:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:3.0:1790100480.110795:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100480.110798:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818000/0x31a8f3fdeeefd7e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dc9 expref: 16 pid: 11548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110822:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:3.0:1790100480.110824:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790100480.110828:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900afe00/0x31a8f3fdeeefd80f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64dd7 expref: 15 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110839:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:3.0:1790100480.110841:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790100480.110844:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae400/0x31a8f3fdeeefde75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f90 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110854:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:3.0:1790100480.110856:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100480.110859:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900ae600/0x31a8f3fdeeefd878 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64df3 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110869:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:3.0:1790100480.110871:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790100480.110875:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67900aee00/0x31a8f3fdeeefd4e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d05 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110884:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d6799df4500) 00010000:00010000:3.0:1790100480.110886:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100480.110889:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12200/0x31a8f3fdeeefd186 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c17 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110903:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d6799df4a00) 00010000:00010000:3.0:1790100480.110905:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790100480.110913:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefd1f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c33 expref: 10 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110928:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d6787edf500) 00010000:00010000:3.0:1790100480.110930:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790100480.110933:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12000/0x31a8f3fdeeefde9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64f9e expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110947:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d6787defa00) 00010000:00010000:3.0:1790100480.110949:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790100480.110953:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefd705 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64d91 expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100480.110965:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d67bf540000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1790100480.110978:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100480.110980:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100480.110981:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100480.555690:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100480.561597:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100480.561692:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100480.561785:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109517696 00000100:00100000:1.0:1790100480.561798:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109517696 00000100:00100000:1.0:1790100480.561878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:1.0:1790100480.561890:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+6:2360:x1877056109517696:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:1.0:1790100480.561972:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25abe39-6b64-46c4-a568-4506410538f0+6:2360:x1877056109517696:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100480.561980:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 163 00000100:00100000:0.0:1790100480.562090:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109517568 00000100:00100000:0.0:1790100480.562095:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109517568 00000100:00100000:0.0:1790100480.562134:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 299 00000100:00100000:0.0:1790100480.562142:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109517568:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100480.562170:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109517568:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100480.562176:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 299 00000100:00080000:3.0:1790100480.562431:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100481.255001:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790100481.255028:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126268544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100481.255120:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100481.255292:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126268544 00000100:00100000:1.0:1790100481.255301:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126268544 00000100:00100000:1.0:1790100481.255383:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790100481.255394:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126268544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100481.255432:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100481.255500:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126268544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100481.255529:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790100481.255859:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126268544:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790100481.256554:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100481.256834:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126269056:0@lo:400:kworker.0 00000100:00100000:0.0:1790100481.256881:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100481.256916:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790100481.256922:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126268672:0@lo:400:kworker.0 00000100:00100000:0.0:1790100481.256953:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100481.256974:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126269184:0@lo:400:kworker.0 00000100:00100000:0.0:1790100481.256997:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100481.257025:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126269056 00000100:00100000:0.0:1790100481.257031:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126269056 00000100:00100000:0.0:1790100481.257087:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790100481.257096:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126269056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100481.257137:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126269056:12345-0@lo:400:kworker.0 Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100481.257144:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790100481.257156:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126268800:0@lo:400:kworker.0 00000100:00100000:0.0:1790100481.257164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126268672 00000100:00100000:0.0:1790100481.257176:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126268672 00000100:00100000:3.0:1790100481.257185:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100481.257207:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790100481.257213:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1790100481.257220:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126268672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100481.257222:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126268928:0@lo:400:kworker.0 00000100:00100000:3.0:1790100481.257244:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100481.257248:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126268672:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100481.257254:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:1.0:1790100481.257641:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100481.257683:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126268672:0@lo:400:kworker.0 00000100:00100000:1.0:1790100481.257695:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126269056:0@lo:400:kworker.0 00000100:00100000:0.0:1790100481.260085:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126269184 00000100:00100000:0.0:1790100481.260100:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126269184 00000100:00100000:0.0:1790100481.260180:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126268800 00000100:00100000:0.0:1790100481.260183:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126268800 00000100:00100000:0.0:1790100481.260206:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126268928 00000100:00100000:0.0:1790100481.260209:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126268928 00000100:00100000:0.0:1790100481.260233:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790100481.260243:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126269184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100481.260332:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126269184:12345-0@lo:400:kworker.0 Request processed in 91us (3334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100481.260339:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1790100481.260485:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100481.260530:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790100481.260539:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126268800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100481.260591:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126268800:12345-0@lo:400:kworker.0 Request processed in 55us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100481.260597:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790100481.260628:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790100481.260636:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126268928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100481.261155:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126268928:12345-0@lo:400:kworker.0 Request processed in 519us (3908us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100481.261163:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790100481.261219:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126269184:0@lo:400:kworker.0 00000100:00100000:2.0:1790100481.261543:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126268928:0@lo:400:kworker.0 00000100:00100000:2.0:1790100481.261556:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126268800:0@lo:400:kworker.0 00010000:00010000:3.0:1790100481.575514:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100482.282327:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790100482.282378:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126269312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100482.282483:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100482.286830:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126269312 00000100:00100000:1.0:1790100482.286850:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126269312 00000100:00100000:1.0:1790100482.286938:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790100482.286952:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126269312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100482.287009:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100482.287105:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126269312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100482.287112:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790100482.288968:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126269312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100482.513181:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100482.513226:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100482.513270:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100482.513419:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109517824 00000100:00100000:1.0:1790100482.513459:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109517824 00000100:00100000:1.0:1790100482.513525:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109518080 00000100:00100000:1.0:1790100482.513529:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109518080 00000100:00100000:1.0:1790100482.513542:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109517952 00000100:00100000:1.0:1790100482.513545:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109517952 00000100:00100000:1.0:1790100482.513563:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:1.0:1790100482.513573:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+12:2360:x1877056109517824:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100482.513601:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100482.513670:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780031400/0x31a8f3fdeeefcf8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b53 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100482.513690:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100482.513752:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+11:2360:x1877056109517824:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 180us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100482.513760:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:1.0:1790100482.513779:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:1.0:1790100482.513786:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+10:2360:x1877056109518080:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100482.513794:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100482.513802:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefd12b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64c02 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100482.513811:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100482.514541:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+9:2360:x1877056109518080:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 44us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100482.514550:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:1.0:1790100482.514762:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:1.0:1790100482.514774:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+8:2360:x1877056109517952:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100482.514799:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100482.514812:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781657200/0x31a8f3fdeeefcf95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b7d expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100482.514825:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100482.515243:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+7:2360:x1877056109517952:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 470us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100482.515251:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:3.0:1790100482.542304:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100482.543474:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109518336 00000100:00100000:1.0:1790100482.543489:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109518336 00000100:00100000:1.0:1790100482.543605:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 240 00000100:00100000:1.0:1790100482.543647:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+6:2356:x1877056109518336:12345-192.168.201.18@tcp:39:umount.0 00000020:00000080:1.0:1790100482.543898:0:5841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcfa3 00000020:00010000:1.0:1790100482.543983:0:5841:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d67bf590800: total 0 00000100:00080000:1.0:1790100482.543991:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8d67bf591000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790100482.544029:0:5841:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1790100482.544458:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25abe39-6b64-46c4-a568-4506410538f0+5:2356:x1877056109518336:12345-192.168.201.18@tcp:39:umount.0 Request processed in 814us (2163us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1790100482.544468:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 240 00000020:00010000:0.0:1790100482.544512:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d67bf590800: total 0 00010000:00010000:0.0:1790100482.544551:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d67bf590800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790100482.544581:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787ec1a00) 00010000:00010000:0.0:1790100482.544584:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790100482.544591:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12a00/0x31a8f3fdeeefdec2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fac expref: 4 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100482.544699:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d67bf590800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790100482.544711:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100482.544713:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100482.544715:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100482.544876:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790100482.598844:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100482.618519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100482.618647:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109518592 00000100:00100000:1.0:1790100482.618662:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109518592 00000100:00100000:1.0:1790100482.618742:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 301 00000100:00100000:1.0:1790100482.618755:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+7:2356:x1877056109518592:12345-192.168.201.18@tcp:251:umount.0 00000020:00000080:1.0:1790100482.618818:0:5834:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefce99 00000020:00010000:1.0:1790100482.618827:0:5834:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d6787673800: total 0 00000100:00080000:1.0:1790100482.618841:0:5834:0:(import.c:65:import_set_state_nolock()) ffff8d6787676000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790100482.619588:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67834fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecdcb1a1-7d2e-433e-8696-b6cc55d35b85+3:2356:x1877056109518592:12345-192.168.201.18@tcp:251:umount.0 Request processed in 832us (1076us total) trans 0 rc 0/0 00000020:00010000:3.0:1790100482.620293:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d6787673800: total 0 00010000:00010000:3.0:1790100482.620302:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100482.620366:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d6787673800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790100482.620407:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781657a00/0x31a8f3fdeeefcf4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64b45 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100482.620442:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d6787673800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790100482.620454:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100482.620456:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100482.620458:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100482.620754:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 301 00000020:00000080:1.0:1790100482.620771:0:5834:0:(genops.c:885:class_export_put()) final put ffff8d6787673800/ecdcb1a1-7d2e-433e-8696-b6cc55d35b85 00000020:00000080:2.0:1790100482.621802:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6787673800/ecdcb1a1-7d2e-433e-8696-b6cc55d35b85 for MGS 00000020:00000080:2.0:1790100482.621854:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d6787676000 for MGS 00000001:00100000:0.0:1790100482.914454:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:0.0:1790100482.914472:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d6799d92000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:0.0:1790100482.914507:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6799d92000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c for lustre-OST0001 00000020:00000080:0.0:1790100482.914588:0:487:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d6799d94000 for lustre-OST0001 00000001:00100000:3.0:1790100482.948342:0:5863:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d25abe39-6b64-46c4-a568-4506410538f0 00000001:00080000:3.0:1790100482.948369:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1790100482.948377:0:5863:0:(genops.c:885:class_export_put()) final put ffff8d67bf590800/d25abe39-6b64-46c4-a568-4506410538f0 00000001:00080000:3.0:1790100482.950920:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1790100482.950954:0:5863:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000001:00080000:3.0:1790100482.950969:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1790100482.950975:0:5863:0:(genops.c:885:class_export_put()) final put ffff8d67bf540000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c 00000020:00000080:1.0:1790100482.962757:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf590800/d25abe39-6b64-46c4-a568-4506410538f0 for lustre-MDT0000 00000020:00000080:3.0:1790100482.971488:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67bf591000 for lustre-MDT0000 00000020:00000080:3.0:1790100482.971506:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf540000/dd2cd87b-6ca1-4323-9b74-fad785d94e6c for lustre-MDT0000 00000020:00000080:3.0:1790100482.971603:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67b5cd0800 for lustre-MDT0000 00010000:00010000:3.0:1790100483.628300:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100484.653113:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790100485.271430:0:12980:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790100485.294605:0:12980:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790100485.294671:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.294689:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.294697:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.294704:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.294728:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790100485.294735:0:12980:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790100485.294766:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790100485.294771:0:12980:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790100485.294777:0:12980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790100485.295417:0:12980:0:(import.c:65:import_set_state_nolock()) ffff8d67853ac000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1790100485.297931:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100485.297943:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.297953:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf531800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100485.297956:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.297984:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100485.297990:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100485.297993:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100485.297996:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790100485.297998:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790100485.298040:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.298044:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100485.298072:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.298077:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67bf531800/0x31a8f3fdeeefcf1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcf25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.298088:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100485.298089:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100485.298090:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100485.298097:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100485.298114:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126269568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100485.298186:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100485.298241:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126269568 00000100:00100000:2.0:1790100485.298247:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126269568 00000100:00100000:2.0:1790100485.298296:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790100485.298306:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3311:x1877056126269568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100485.298328:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100485.298341:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781657c00/0x31a8f3fdeeefcf25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf1e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.298352:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100485.298403:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:3311:x1877056126269568:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100485.298410:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790100485.298470:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126269568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100485.298740:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126269440:0@lo:39:umount.0 00000100:00100000:0.0:1790100485.298776:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100485.299310:0:11548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126269440 00000100:00100000:2.0:1790100485.299316:0:11548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126269440 00000100:00100000:2.0:1790100485.299349:0:11548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790100485.299356:0:11548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877056126269440:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790100485.299393:0:11548:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcca8 00000100:00080000:2.0:1790100485.299405:0:11548:0:(import.c:65:import_set_state_nolock()) ffff8d67b59e9800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790100485.299588:0:11548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1877056126269440:12345-0@lo:39:umount.0 Request processed in 231us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100485.299595:0:11548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:2.0:1790100485.299605:0:11548:0:(genops.c:885:class_export_put()) final put ffff8d67b59ed000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1790100485.299655:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67b59ed000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790100485.299702:0:487:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67b59e9800 for lustre-MDT0000 00000100:00080000:0.0:1790100485.299760:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67853ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790100485.299773:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126269440:0@lo:39:umount.0 00000100:00080000:2.0:1790100485.299915:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790100485.299918:0:12980:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790100485.299922:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790100485.300306:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100485.304111:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304133:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304141:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304149:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304285:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100485.304294:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304302:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304309:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304338:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.304389:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100485.304397:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.304414:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67bf531600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100485.304418:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.304427:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100485.304435:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100485.304564:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100485.304568:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1790100485.304650:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.304657:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100485.304687:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.304694:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67bf531600/0x31a8f3fdeeefcf2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcf33 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.304709:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100485.304712:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.304719:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fe000 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100485.304722:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.304739:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100485.304745:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100485.304751:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100485.304753:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1790100485.304765:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.304772:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100485.304778:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304895:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1790100485.304902:0:12980:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790100485.304912:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304922:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304928:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304936:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304945:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100485.304951:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304958:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304964:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.304985:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100485.305005:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790100485.305008:0:12980:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1790100485.305012:0:12980:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790100485.305064:0:12980:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790100485.305070:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790100485.305076:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790100485.305082:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1790100485.305091:0:12980:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d67b59e8000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790100485.305097:0:12980:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d67bf590000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790100485.305103:0:12980:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8d6787dc8000) has exports, disconnecting them 00000020:00080000:0.0:1790100485.305108:0:12980:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d67b59e8000), last request at 1790100481 00000020:00000080:0.0:1790100485.305117:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefce1b 00000100:00080000:0.0:1790100485.305142:0:12980:0:(import.c:65:import_set_state_nolock()) ffff8d67b59ef800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790100485.305365:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126269696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100485.305763:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790100485.306256:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100485.306268:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67c21fe000/0x31a8f3fdeeefce53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefce5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.306295:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100485.306299:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.306305:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fea00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100485.306308:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.306317:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100485.306324:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100485.306336:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100485.306339:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790100485.306341:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1790100485.306371:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.306377:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100485.306412:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.306419:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67c21fea00/0x31a8f3fdeeefcc07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcc0e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100485.306432:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100485.306434:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100485.306435:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790100485.306593:0:12980:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d67b59e8000): rc 0 00000020:00000080:0.0:1790100485.306597:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67b59e8000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:1.0:1790100485.306951:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100485.306962:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126269824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100485.306975:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100485.306982:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100485.306989:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818e00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1790100485.306993:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100485.307001:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100485.307007:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100485.307010:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1790100485.307014:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790100485.307016:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790100485.307019:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790100485.307036:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100485.307042:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790100485.307046:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126269696 00010000:00010000:3.0:1790100485.307050:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100485.307055:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126269696 00010000:00010000:3.0:1790100485.307056:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67ad818e00/0x31a8f3fdeeefd155 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefd15c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100485.307076:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100485.307078:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100485.307079:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100485.307083:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100485.307085:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100485.307104:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126269824 00000100:00100000:1.0:1790100485.307106:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126269824 00000100:00100000:3.0:1790100485.307115:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790100485.307126:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784f87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126269696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100485.307140:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100485.307154:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67900afa00/0x31a8f3fdeeefcf33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf2c expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100485.307165:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100485.307206:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784f87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+18:3313:x1877056126269696:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100485.307360:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126269952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100485.307399:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100485.307419:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790100485.307425:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126270080:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1790100485.307666:0:12980:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d67bf590000), last request at 1790100481 00000020:00000080:0.0:1790100485.307694:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcd42 00000100:00080000:0.0:1790100485.307724:0:12980:0:(import.c:65:import_set_state_nolock()) ffff8d67bf597800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790100485.307904:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126269952 00000100:00100000:1.0:1790100485.307910:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126269952 00000100:00100000:1.0:1790100485.307933:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790100485.307940:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+19:3313:x1877056126269824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100485.307950:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100485.307960:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780030e00/0x31a8f3fdeeefce5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefce53 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.307973:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100485.308000:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+18:3313:x1877056126269824:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100485.308006:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790100485.308022:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790100485.308027:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+17:3311:x1877056126269952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100485.308042:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100485.308049:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781523800/0x31a8f3fdeeefcc0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcc07 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.308059:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100485.308078:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44df9276-3139-4fbb-af61-ceba3e95d22a+16:3311:x1877056126269952:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100485.308083:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790100485.308270:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100485.308314:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126269952:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1790100485.308348:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67b59e8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1790100485.308408:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790100485.308452:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126270080 00000100:00100000:3.0:1790100485.308456:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126270080 00000100:00100000:3.0:1790100485.308478:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790100485.308484:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+15:3311:x1877056126270080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100485.308490:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100485.308499:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67ad818c00/0x31a8f3fdeeefd15c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefd155 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100485.308508:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100485.308536:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44df9276-3139-4fbb-af61-ceba3e95d22a+14:3311:x1877056126270080:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100485.308542:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000020:00000080:2.0:1790100485.308647:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67b59ef800 for lustre-MDT0000 00000100:00100000:2.0:1790100485.308680:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44df9276-3139-4fbb-af61-ceba3e95d22a:3311:1877056126270080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100485.308700:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100485.309075:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126269824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100485.309085:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44df9276-3139-4fbb-af61-ceba3e95d22a:3313:1877056126269696:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790100485.310274:0:12980:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d67bf590000): rc 0 00000020:00000080:1.0:1790100485.310279:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67bf590000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1790100485.310302:0:12980:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb05f8106fae0 00000100:00080000:1.0:1790100485.310327:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790100485.310331:0:12980:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1790100485.310344:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:2.0:1790100485.310427:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf590000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1790100485.310566:0:12980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790100485.310593:0:12980:0:(import.c:65:import_set_state_nolock()) ffff8d67aee72800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790100485.310624:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790100485.310627:0:12980:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1790100485.310636:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790100485.310700:0:12980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790100485.310712:0:12980:0:(import.c:65:import_set_state_nolock()) ffff8d67bbb84800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790100485.310742:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d6787dc8000) has no exports 00000100:00100000:0.0:1790100485.310963:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126270208:0@lo:9:umount.0 00000100:00100000:0.0:1790100485.311027:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100485.311065:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126270336:0@lo:9:umount.0 00000100:00100000:0.0:1790100485.311084:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100485.311117:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126270208 00000100:00100000:0.0:1790100485.311125:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126270208 00000020:00000080:2.0:1790100485.311300:0:487:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67bf597800 for lustre-MDT0000 00000100:00100000:0.0:1790100485.311604:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126270336 00000100:00100000:0.0:1790100485.311626:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126270336 00000100:00100000:0.0:1790100485.311658:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790100485.311676:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877056126270208:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790100485.311707:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcdab 00000100:00080000:0.0:1790100485.311717:0:6687:0:(import.c:65:import_set_state_nolock()) ffff8d67bf543000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790100485.311753:0:6687:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1790100485.311843:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100485.311958:0:12004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790100485.311968:0:12004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877056126270336:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790100485.311983:0:12004:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefce84 00000100:00080000:1.0:1790100485.311996:0:12004:0:(import.c:65:import_set_state_nolock()) ffff8d67bbb84000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790100485.312453:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1877056126270208:12345-0@lo:9:umount.0 Request processed in 769us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100485.312461:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1790100485.312488:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790100485.312492:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100485.312764:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67aee72800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790100485.312786:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790100485.312788:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100485.312793:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126270208:0@lo:9:umount.0 00000001:00000004:1.0:1790100485.312839:0:12004:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1790100485.313072:0:12004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3310:x1877056126270336:12345-0@lo:9:umount.0 Request processed in 1105us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100485.313080:0:12004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1790100485.313108:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67bbb84800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790100485.313117:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790100485.313119:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790100485.313122:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126270336:0@lo:9:umount.0 00010000:00010000:3.0:1790100485.316059:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1790100485.325742:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d6787dc8000) has no exports 00000020:00000080:3.0:1790100485.371988:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcc62 00000020:00000080:3.0:1790100485.372005:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67a20a8000/lustre-QMT0000_UUID 00000020:01000000:3.0:1790100485.372071:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790100485.372150:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67a20a8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790100485.372183:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100485.372194:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790100485.372198:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8d6787cecd40) has no exports 00000020:00000080:2.0:1790100485.372573:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcc5b 00000020:00000080:2.0:1790100485.372579:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67ae56f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790100485.372918:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67ae56f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790100485.372992:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100485.373001:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790100485.373004:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d6787cf7000/lustre-QMT0000_UUID 00000020:00000080:2.0:1790100485.373007:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6787cf7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790100485.373012:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1790100485.373159:0:12980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6782fbda80 - data ffff8d67bfdb0000/ffff8d67bf513400 00000020:01000000:2.0:1790100485.373307:0:12980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6787684600 - data ffff8d67a75580d8/ffff8d67bb20c400 00000001:00000004:2.0:1790100485.391884:0:12980:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1790100485.431147:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790100485.431156:0:12980:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1790100485.431179:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100485.431182:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790100485.431591:0:6833:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790100485.431596:0:6833:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1790100485.431645:0:6833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790100485.433913:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790100485.433920:0:12980:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1790100485.433975:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100485.433978:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790100485.434234:0:8113:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790100485.434239:0:8113:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1790100485.434252:0:8113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1790100485.503323:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcc2a 00000020:00000080:2.0:1790100485.503338:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67ad88f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790100485.503520:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67ad88f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790100485.505917:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcc3f 00000020:00000080:2.0:1790100485.505953:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67ad88b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790100485.506023:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1790100485.506031:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100485.506043:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790100485.506047:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8d6787dc99c0) has no exports 00000004:01000000:2.0:1790100485.506221:0:12980:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790100485.506231:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefce7d 00000020:00000080:2.0:1790100485.506236:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67bbb83000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790100485.506797:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67ad88b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1790100485.507150:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790100485.507156:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100485.507166:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790100485.507169:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8d6784ed99c0) has no exports 00000020:00000080:2.0:1790100485.507179:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefce76 00000020:00000080:2.0:1790100485.507184:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67bbb87800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790100485.507357:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bbb83000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790100485.507857:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bbb87800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790100485.508248:0:12980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790100485.508264:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790100485.508270:0:12980:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1790100485.508277:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100485.508280:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790100485.508331:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100485.508340:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790100485.508350:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcd88 00000020:00000080:2.0:1790100485.508356:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d66811e4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790100485.508361:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790100485.508365:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100485.508370:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790100485.508372:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d6787ce99c0) has no exports 00000020:00000080:2.0:1790100485.508386:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcd81 00000020:00000080:2.0:1790100485.508389:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67aee71800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1790100485.508981:0:12980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790100485.508984:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790100485.508987:0:12980:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1790100485.509003:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790100485.509005:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790100485.509034:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100485.509040:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790100485.509069:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100485.509072:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790100485.509075:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67853a9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790100485.509078:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67853a9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1790100485.509084:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790100485.509350:0:487:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67bbb84800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790100485.509357:0:487:0:(genops.c:885:class_export_put()) final put ffff8d67bf592000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790100485.509360:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf592000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790100485.509363:0:487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790100485.509419:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d66811e4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790100485.509424:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67aee71800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790100485.509428:0:487:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67aee72800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790100485.509433:0:487:0:(genops.c:885:class_export_put()) final put ffff8d6799f65000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790100485.509452:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6799f65000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1790100485.509455:0:487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790100485.509751:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcc46 00000020:00000080:2.0:1790100485.509759:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67ad88a000/lustre-MDD0000_UUID 00000020:01000000:2.0:1790100485.509774:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1790100485.509779:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100485.509784:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790100485.509787:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8d6787dcb380) has no exports 00000020:00000080:2.0:1790100485.509806:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100485.509811:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1790100485.509814:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcc4d 00000020:00000080:2.0:1790100485.509818:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67ad88c000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790100485.509830:0:12980:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6788844800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1790100485.509834:0:12980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6788844800 3 00000020:01000004:2.0:1790100485.509837:0:12980:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d6788844800 from lustre-MDT0000 00000020:00000080:2.0:1790100485.509859:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100485.509863:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1790100485.509866:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d67ad888000/lustre-MDT0000_UUID 00000020:00000080:2.0:1790100485.509868:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67ad888000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1790100485.509876:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1790100485.509904:0:12980:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1790100485.509907:0:12980:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1790100485.509910:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1790100485.509912:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100485.509915:0:12980:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790100485.509922:0:12980:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8d67a5ba2800 44df9276-3139-4fbb-af61-ceba3e95d22a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790100485.509933:0:12980:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8d6784ed8000) has exports, disconnecting them 00000020:00080000:2.0:1790100485.509937:0:12980:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d67a5ba2800), last request at 1790100276 00000020:00000080:2.0:1790100485.509953:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcbeb 00000020:00010000:2.0:1790100485.509957:0:12980:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d67a5ba2800: total 2 00000100:00080000:2.0:1790100485.509962:0:12980:0:(import.c:65:import_set_state_nolock()) ffff8d67a5ba0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790100485.510022:0:12980:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d67a5ba2800): rc 0 00000020:00080000:2.0:1790100485.510026:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8d6784ed8000) has no exports 00000100:00100000:2.0:1790100485.510089:0:5836:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d6784e98800:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1790100485.510230:0:5835:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d6787bf6800:5835] 1 exiting: rc = 0 00000020:00000080:0.0:1790100485.510360:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67ad88a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1790100485.510366:0:487:0:(genops.c:885:class_export_put()) final put ffff8d67ad88e800/lustre-MDD0000_UUID 00000020:00000080:0.0:1790100485.510368:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67ad88e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1790100485.510374:0:487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1790100485.510570:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67ad88c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1790100485.510807:0:5834:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d6784e99c00:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1790100485.510905:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510913:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510918:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510924:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510930:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510936:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510942:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510949:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510955:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510961:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510966:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510972:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510977:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510983:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510989:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.510994:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511000:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511006:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511011:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511018:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511024:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511031:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511037:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511043:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511059:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511066:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511071:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511076:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511081:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511087:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511093:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511098:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511103:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511108:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511114:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511119:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511124:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511130:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511135:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511141:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511147:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511152:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511166:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511172:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511178:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511185:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511192:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511198:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511204:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511210:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511215:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511221:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511227:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511232:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511239:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511245:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511250:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511516:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511523:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511535:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511541:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511547:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511553:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100485.511558:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1790100485.513676:0:5831:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d67a5ba2800: total 0 00010000:00010000:1.0:1790100485.513743:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d67a5ba2800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1790100485.513796:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf531e00/0x31a8f3fdeeefcf41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf3a expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.513818:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781656800/0x31a8f3fdeeefd14e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefd147 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.513830:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67900afc00/0x31a8f3fdeeefceed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcee6 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.513840:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf530600/0x31a8f3fdeeefcefb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcef4 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.513850:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67bf530a00/0x31a8f3fdeeefcf17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf10 expref: 5 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.513860:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780030400/0x31a8f3fdeeefcf09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefcf02 expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.513877:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6781656200/0x31a8f3fdeeefd140 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefd139 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.513912:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6780031e00/0x31a8f3fdeeefccf5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x31a8f3fdeeefccee expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100485.513922:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d67a5ba2800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1790100485.513935:0:5831:0:(genops.c:885:class_export_put()) final put ffff8d67a5ba2800/44df9276-3139-4fbb-af61-ceba3e95d22a 00010000:00010000:1.0:1790100485.513948:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100485.513950:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100485.513952:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790100485.514367:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67a5ba2800/44df9276-3139-4fbb-af61-ceba3e95d22a for MGS 00000020:00000080:0.0:1790100485.514420:0:487:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67a5ba0000 for MGS 20000000:01000000:2.0:1790100485.514638:0:12980:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790100485.514642:0:12980:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1790100485.516056:0:12980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6782fbdde0 - data ffff8d67a77c36c0/ffff8d67bf510400 00000020:01000000:2.0:1790100485.516221:0:12980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6788936000 - data ffff8d67a756f288/ffff8d67889aa000 00000020:00000080:2.0:1790100485.517144:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcbcf 00000020:00000080:2.0:1790100485.517153:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d6788843000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790100485.517346:0:12980:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6788844800 from MGS, refs=2 00000020:01000004:2.0:1790100485.517350:0:12980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6788844800 2 00000020:01000004:2.0:1790100485.517354:0:12980:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d6788844800 from MGS 00000020:00000080:2.0:1790100485.517389:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100485.517397:0:12980:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1790100485.517400:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d6788840000/MGS 00000020:00000080:2.0:1790100485.517402:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6788840000/MGS for MGS 00000020:01000000:2.0:1790100485.517410:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1790100485.517545:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6788843000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1790100485.517710:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1790100485.517714:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100485.517721:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790100485.517728:0:12980:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d6787b8b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790100485.517734:0:12980:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8d6787a28000) has exports, disconnecting them 00000020:00080000:2.0:1790100485.517739:0:12980:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d6787b8b800), last request at 1790100277 00000020:00000080:2.0:1790100485.517744:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcc9a 00000020:00080000:2.0:1790100485.517754:0:12980:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6787b8b800): rc 0 00000020:00000080:2.0:1790100485.517758:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d6787b8b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790100485.519599:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6787b8b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1790100485.520825:0:12980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1790100485.520834:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790100485.520838:0:12980:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790100485.520846:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790100485.521081:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790100485.521092:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1790100485.521104:0:12980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6788844800 1 00000020:00000080:0.0:1790100485.521112:0:12980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcbc1 00000020:00000080:0.0:1790100485.521123:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d6788847800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1790100485.521129:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790100485.521134:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790100485.521138:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790100485.521142:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8d6787dccd40) has no exports 00000020:00000080:1.0:1790100485.521597:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67853ac000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790100485.521605:0:37:0:(genops.c:885:class_export_put()) final put ffff8d6787cf2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790100485.521608:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6787cf2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790100485.521638:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1790100485.521708:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6788847800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790100485.575778:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100485.575802:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790100485.575809:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d6788c68000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790100485.575813:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6788c68000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790100485.575821:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790100485.575946:0:12980:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d6788c6d000 00000020:01000000:1.0:1790100485.575968:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790100485.575973:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100485.575978:0:12980:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790100485.575982:0:12980:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8d6787ceb380) has no exports 00000100:00100000:0.0:1790100485.578346:0:6711:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8d67bf32d200:6711] 3 exiting: rc = 0 00000100:00100000:0.0:1790100485.579319:0:5841:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8d6799fee000:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1790100485.579944:0:5843:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8d6787daac00:5843] 2 exiting: rc = 0 00000100:00100000:2.0:1790100485.580007:0:11548:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8d67bf438200:11548] 4 exiting: rc = 0 00000100:00100000:3.0:1790100485.580363:0:5842:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8d6799fee600:5842] 1 exiting: rc = 0 00000100:00100000:1.0:1790100485.580778:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.580787:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.580982:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.580997:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581002:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581007:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581013:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581019:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581025:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581031:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581038:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581043:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581049:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581054:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581059:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581063:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581068:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581072:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581077:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581082:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581087:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581091:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581097:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581110:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581117:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581122:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581128:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581134:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581140:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581145:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581151:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581156:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581161:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581177:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581184:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581189:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581193:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581199:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581211:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581217:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581222:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581227:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581232:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581237:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581242:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581248:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581264:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581271:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581276:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581281:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581286:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581292:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581297:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581302:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581308:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581314:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581320:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581325:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581331:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581336:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581342:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581347:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581354:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.581359:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.587700:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d6799fed200:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1790100485.588047:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d6787daaa00:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1790100485.588699:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588708:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588716:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588725:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588732:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588739:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588746:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588753:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588771:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588776:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588783:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588789:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588794:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588799:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588805:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588811:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588815:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588821:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588826:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588831:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588837:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588844:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588849:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588854:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588859:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588864:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588869:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588874:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588878:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588882:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588887:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588892:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588898:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588903:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588909:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588914:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588920:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588925:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588930:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588935:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588939:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588944:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588949:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588960:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588965:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588970:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588974:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588979:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588984:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588988:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588993:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.588998:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589003:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589008:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589013:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589017:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589022:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589027:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589032:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589037:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589041:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589046:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589051:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589056:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.589901:0:12069:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8d67ad4e7400:12069] 2 exiting: rc = 0 00000100:00100000:1.0:1790100485.589981:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8d6787dab800:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1790100485.590085:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8d6799fed800:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1790100485.590239:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590247:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590326:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590335:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590341:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590347:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590354:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590361:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590367:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590374:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590393:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590410:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590425:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590432:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590508:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590516:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590523:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590529:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590536:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590542:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590548:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590554:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590560:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590581:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590588:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590594:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590600:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590607:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590727:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590733:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590739:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590746:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590752:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590758:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590765:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590786:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590793:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590799:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590805:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590811:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590818:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590824:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590830:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590837:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590844:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590849:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590855:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590882:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590889:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590894:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590901:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590907:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590914:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590920:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590928:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590934:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590940:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590945:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590951:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590972:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590979:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590985:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590992:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.590999:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.603488:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d6787dab400:5848] 0 exiting: rc = 1 00000100:00100000:3.0:1790100485.603995:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d6787daa800:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1790100485.604527:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604534:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604540:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604545:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604550:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604555:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604560:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604565:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604570:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604575:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604581:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604586:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604591:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604596:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604601:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604607:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604729:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604735:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604755:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604760:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604765:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604771:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604776:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604782:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604787:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604793:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604798:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604803:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604808:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604820:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604826:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604831:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604836:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604842:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604847:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604853:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604857:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604862:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604866:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604872:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604877:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604881:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604886:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604891:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604897:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604902:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604908:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604913:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604917:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604921:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604926:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604931:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604936:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604952:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604958:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604962:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604968:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604973:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604979:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604983:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604988:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604993:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.604998:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.605003:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606088:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d6787d03800:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1790100485.606359:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d6787d03600:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1790100485.606476:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606492:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606499:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606504:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606510:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606515:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606520:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606525:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606531:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606536:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606542:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606547:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606552:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606556:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606561:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606566:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606570:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606574:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606579:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606585:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606590:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606595:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606601:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606606:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606761:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606768:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606774:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606780:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606785:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606791:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606796:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606801:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606806:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606812:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606818:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606823:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606836:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606842:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606848:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606853:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606863:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606869:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606874:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606879:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606884:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606889:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606895:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606902:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606907:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606911:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606919:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606924:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606929:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606934:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606939:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606945:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606951:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606955:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606960:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606965:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606970:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606975:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606979:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.606985:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.607597:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d6787d02000:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1790100485.607996:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d6787d02600:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1790100485.608358:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608366:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608372:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608388:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608394:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608400:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608405:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608423:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608430:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608446:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608453:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608459:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608464:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608470:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608476:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608482:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608488:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608493:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608499:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608505:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608510:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608516:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608521:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608527:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608532:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608538:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608544:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608549:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608554:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608560:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608566:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608572:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608576:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608582:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608589:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608594:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608599:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608604:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608830:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608839:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608844:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608850:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608862:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608868:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608874:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608879:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608885:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608890:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608896:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608901:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608907:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608912:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608918:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608923:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608929:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608934:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608939:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608943:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608948:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608953:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608958:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608964:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608969:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100485.608974:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.609810:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8d678890a400:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1790100485.610037:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8d678890b200:5856] 2 exiting: rc = 0 00000100:00100000:0.0:1790100485.610337:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8d678890ae00:5854] 0 exiting: rc = 1 00000100:00100000:1.0:1790100485.610573:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610580:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610586:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610591:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610597:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610603:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610635:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610642:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610649:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610655:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610661:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610666:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610671:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610677:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610684:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610689:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610695:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610701:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610707:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610729:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610735:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610756:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610765:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610770:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610779:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610786:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610792:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610798:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610803:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610809:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610814:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610820:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610826:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610831:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610836:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610842:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610847:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610854:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610861:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610867:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610873:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610878:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610885:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610891:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610899:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610918:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610925:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610930:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610935:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610941:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610948:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610954:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610961:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610967:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610979:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610985:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610990:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.610995:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.611000:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.611006:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.611012:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.611017:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.611023:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100485.611029:0:12980:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790100485.619305:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100485.619320:0:12980:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790100485.619326:0:12980:0:(genops.c:885:class_export_put()) final put ffff8d6788842000/MDS_uuid 00000020:00000080:1.0:1790100485.619331:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6788842000/MDS_uuid for MDS 00000020:01000000:1.0:1790100485.619341:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790100485.619474:0:12980:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1790100485.673208:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100486.380848:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126270592:0@lo:400:kworker.0 00000400:00000100:3.0:1790100486.380925:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056126270592 offset 0 length 224: 4 00000100:00100000:3.0:1790100486.380988:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100486.380995:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126270464:0@lo:400:kworker.0 00000400:00000100:3.0:1790100486.381013:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877056126270464 offset 0 length 224: 4 00000100:00100000:3.0:1790100486.381039:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126270720:0@lo:400:kworker.0 00000400:00000100:3.0:1790100486.381057:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056126270720 offset 0 length 224: 4 00010000:00010000:3.0:1790100486.695701:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100487.725185:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790100487.978387:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790100487.978395:0:7647:0:(genops.c:885:class_export_put()) final put ffff8d67bbb82000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790100487.978579:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bbb82000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790100487.978660:0:487:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67bbb84000 for lustre-OST0001 00000020:01000004:3.0:1790100488.491254:0:13133:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790100488.505730:0:13133:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1790100488.505780:0:13133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100488.505797:0:13133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100488.505805:0:13133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100488.505813:0:13133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100488.505849:0:13133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790100488.505855:0:13133:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790100488.505881:0:13133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790100488.505894:0:13133:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d67bf975f80 x1877056126270592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100502 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100488.505911:0:13133:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1790100488.505944:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126270592:0@lo:400:kworker.0 00000100:00080000:3.0:1790100488.505975:0:13133:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790100488.506001:0:13133:0:(import.c:65:import_set_state_nolock()) ffff8d6799ea3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1790100488.506853:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100488.506864:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100488.506873:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100488.506877:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100488.506886:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100488.506893:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100488.506913:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790100488.506916:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790100488.506919:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790100488.506950:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100488.506956:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100488.506978:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100488.506985:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67900ae800/0x31a8f3fdeeefcf02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x31a8f3fdeeefcf09 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100488.506998:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100488.506999:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100488.507001:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100488.511171:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126270976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100488.511246:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100488.511421:0:12013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126270976 00000100:00100000:2.0:1790100488.511448:0:12013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126270976 00000100:00100000:2.0:1790100488.511504:0:12013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790100488.511511:0:12013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1877056126270976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790100488.511528:0:12013:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790100488 with bad export cookie 3578378175906827243 00000100:00100000:1.0:1790100488.513410:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1877056126270848:0@lo:39:umount.0 00000400:00000100:1.0:1790100488.513467:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056126270848 offset 0 length 224: 4 00000100:00100000:3.0:1790100488.520201:0:12013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1877056126270976:12345-0@lo:103:ldlm_bl.0 Request processed in 8681us (8946us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790100488.520216:0:12013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790100488.520287:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790100488.520293:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8d6788c6c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1790100488.520297:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1790100488.527536:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.118@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1790100488.527543:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790100488.527859:0:3312:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d67bf974380 x1877056126270464/t0(0) o400->MGC192.168.201.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790100502 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100488.527878:0:3312:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d67bf3fca80 x1877056126270976/t0(0) o103->MGC192.168.201.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790100504 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790100488.527888:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790100488.527891:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790100488.527892:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790100488.527897:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8d6788c6c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100488.527903:0:3312:0:(import.c:545:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 173 00000100:00080000:0.0:1790100488.527919:0:3312:0:(import.c:666:import_select_connection()) MGC192.168.201.118@tcp: import ffff8d6788c6c800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100488.528298:0:3312:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67b5a82680 x1877056126271104/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100488.528344:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44df9276-3139-4fbb-af61-ceba3e95d22a:3312:1877056126270976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100488.528380:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44df9276-3139-4fbb-af61-ceba3e95d22a:3310:1877056126271104:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1790100488.528430:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877056126271104 offset 0 length 520: 4 00000100:00100000:3.0:1790100488.528600:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44df9276-3139-4fbb-af61-ceba3e95d22a:3314:1877056126270464:0@lo:400:kworker.0 00010000:00010000:3.0:1790100488.742040:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100489.766378:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790100490.018582:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790100490.018592:0:6714:0:(genops.c:885:class_export_put()) final put ffff8d67bf546000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790100490.018641:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf546000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790100490.018701:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67bf543000 for lustre-OST0000 00010000:00010000:1.0:1790100490.790105:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790100491.494447:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790100491.494460:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790100491.494657:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126271232:0@lo:400:kworker.0 00000400:00000100:2.0:1790100491.494721:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056126271232 offset 0 length 224: 4 00010000:00010000:3.0:1790100491.814650:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100492.839250:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100493.543348:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790100493.543367:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790100493.543599:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100493.543634:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126271360:0@lo:400:kworker.0 00000400:00000100:2.0:1790100493.543696:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056126271360 offset 0 length 224: 4 00010000:00010000:1.0:1790100493.862360:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100494.891793:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100495.910187:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100496.935708:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100497.959415:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100498.662713:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790100498.662725:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790100498.662918:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126271488:0@lo:400:kworker.0 00000400:00000100:0.0:1790100498.662993:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056126271488 offset 0 length 224: 4 00000100:00100000:0.0:1790100498.663373:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100488/real 1790100488] req@ffff8d67b5a82680 x1877056126271104/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790100498 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100498.663406:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d67b5a82680 x1877056126271104/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790100498 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100498.663438:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100488/real 1790100488] req@ffff8d67bf975f80 x1877056126270848/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790100498 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100498.663453:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d67bf975f80 x1877056126270848/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790100498 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790100498.663467:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d6788c6c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100498.663487:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790100498.663491:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44df9276-3139-4fbb-af61-ceba3e95d22a:3310:1877056126271104:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1790100498.663498:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d6799ea3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790100498.663595:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790100498.663605:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790100498.663608:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d6788c6c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790100498.663630:0:37:0:(import.c:545:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 385 00000100:00080000:3.0:1790100498.663636:0:37:0:(import.c:630:import_select_connection()) MGC192.168.201.118@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790100498.663649:0:37:0:(import.c:666:import_select_connection()) MGC192.168.201.118@tcp: import ffff8d6788c6c800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1790100498.663670:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67bf976680 x1877056126271616/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100498.663794:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1877056126270848:0@lo:39:umount.0 00000100:00100000:0.0:1790100498.663823:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44df9276-3139-4fbb-af61-ceba3e95d22a:3310:1877056126271616:0@lo:250:kworker.0 00000400:00000100:0.0:1790100498.663850:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877056126271616 offset 0 length 520: 4 00000100:00080000:1.0:1790100498.666134:0:13133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790100498.666144:0:13133:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790100498.666151:0:13133:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790100498.671297:0:13133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100498.671335:0:13133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100498.671343:0:13133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100498.671350:0:13133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100498.673727:0:13133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790100498.673749:0:13133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100498.673762:0:13133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100498.673769:0:13133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100498.673777:0:13133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100498.674601:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100498.674621:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100498.674631:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100498.674635:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100498.674644:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100498.674653:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100498.674659:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100498.674662:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1790100498.674673:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d6788c6c800 00010000:00010000:2.0:1790100498.674677:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100498.674700:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67900af200/0x31a8f3fdeeefcf10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefcf17 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100498.674719:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100498.674723:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100498.674729:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13c00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100498.674733:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100498.674739:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100498.674746:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100498.674751:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790100498.674753:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790100498.674757:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d6788c6c800 00010000:00010000:2.0:1790100498.674760:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100498.674765:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100498.674767:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100498.674769:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100498.675359:0:13133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790100498.675368:0:13133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefd147 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefd14e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100498.675379:0:13133:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1790100498.675385:0:13133:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1790100498.675387:0:13133:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1790100498.675509:0:13133:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1790100498.675513:0:13133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1790100498.675520:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100498.675525:0:13133:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790100498.675529:0:13133:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d6784edcd40) has no exports 00000020:00080000:1.0:1790100498.675556:0:13133:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8d6784edcd40) has no exports 00010000:00010000:2.0:1790100498.679640:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790100498.681585:0:13133:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d67bf99d600 - data ffff8d67b07f7288/ffff8d67ad80f400 00000020:01000000:0.0:1790100498.681766:0:13133:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d67bf524f00 - data ffff8d67a77615e8/ffff8d67bf4b6c00 00100000:10000000:0.0:1790100498.693343:0:13133:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790100498.723539:0:13133:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcd11 00000020:00000080:2.0:1790100498.723548:0:13133:0:(genops.c:885:class_export_put()) final put ffff8d67bf594000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790100498.723582:0:13133:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d67ad888800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790100498.723586:0:13133:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67ad888800 2 00000020:01000004:2.0:1790100498.723589:0:13133:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d67ad888800 from lustre-OST0000 00000020:00000080:2.0:1790100498.723637:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100498.723646:0:13133:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790100498.723650:0:13133:0:(genops.c:885:class_export_put()) final put ffff8d6799ea4800/lustre-OST0000_UUID 00000020:00000080:2.0:1790100498.723653:0:13133:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6799ea4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790100498.723659:0:13133:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790100498.723698:0:13133:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790100498.723702:0:13133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790100498.723706:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100498.723711:0:13133:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790100498.723718:0:13133:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d6799ea6800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790100498.723723:0:13133:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8d67ad41b380) has exports, disconnecting them 00000020:00080000:2.0:1790100498.723727:0:13133:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d6799ea6800), last request at 1790100290 00000020:00000080:2.0:1790100498.723731:0:13133:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcd3b 00000020:00080000:2.0:1790100498.723739:0:13133:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6799ea6800): rc 0 00000020:00000080:2.0:1790100498.723744:0:13133:0:(genops.c:885:class_export_put()) final put ffff8d6799ea6800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790100498.724426:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf594000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790100498.724439:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6799ea6800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1790100498.750661:0:13133:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790100498.750670:0:13133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790100498.750674:0:13133:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790100498.750681:0:13133:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790100498.750868:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100498.750876:0:13133:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1790100498.750883:0:13133:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67ad888800 1 00000020:00000080:3.0:1790100498.750889:0:13133:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcccb 00000020:00000080:3.0:1790100498.750897:0:13133:0:(genops.c:885:class_export_put()) final put ffff8d67834ef000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1790100498.750902:0:13133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1790100498.750909:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790100498.750913:0:13133:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790100498.750917:0:13133:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8d67ad418000) has no exports 00000020:00000080:1.0:1790100498.751274:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d6799ea3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790100498.751282:0:37:0:(genops.c:885:class_export_put()) final put ffff8d67bf542800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790100498.751285:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf542800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790100498.751298:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790100498.751348:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67834ef000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790100498.774457:0:13133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790100498.774473:0:13133:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1790100498.774479:0:13133:0:(genops.c:885:class_export_put()) final put ffff8d67853ab000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790100498.774483:0:13133:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67853ab000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790100498.774494:0:13133:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1790100498.774651:0:13133:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d67ad889000 00000020:02000400:3.0:1790100498.774697:0:13133:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1790100498.989469:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100500.006877:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100501.038383:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100502.054708:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790100502.327773:0:13286:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790100502.348819:0:13286:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1790100502.348922:0:13286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100502.348937:0:13286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100502.348944:0:13286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100502.348969:0:13286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100502.348995:0:13286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790100502.349001:0:13286:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790100502.349023:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790100502.349036:0:13286:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d67bf974a80 x1877056126270720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100502 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100502.349054:0:13286:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d67b5a83480 x1877056126271232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100507 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100502.349065:0:13286:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d67bf974380 x1877056126271360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100509 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100502.349073:0:13286:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d67bf977b80 x1877056126271488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100514 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100502.349082:0:13286:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1790100502.349123:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126271488:0@lo:400:kworker.0 00000100:00100000:0.0:1790100502.349133:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126270720:0@lo:400:kworker.0 00000100:00080000:0.0:1790100502.349164:0:13286:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790100502.349193:0:13286:0:(import.c:65:import_set_state_nolock()) ffff8d67b5cd2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790100502.349225:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1877056126271744:0@lo:39:umount.0 00000400:00000100:0.0:1790100502.349279:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877056126271744 offset 0 length 224: 4 00010000:00010000:2.0:1790100502.351584:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100502.352062:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100502.352080:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6780030200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100502.352085:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100502.352105:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100502.352114:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100502.352141:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100502.352144:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790100502.352148:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790100502.352168:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d6788c6c800 00010000:00010000:2.0:1790100502.352173:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100502.352181:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6780030200/0x31a8f3fdeeefcee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefceed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100502.352198:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100502.352200:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100502.352202:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100502.352245:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126271360:0@lo:400:kworker.0 00000100:00100000:2.0:1790100502.352256:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126271232:0@lo:400:kworker.0 00010000:00010000:3.0:1790100503.079536:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790100503.783014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790100503.783025:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1790100504.104525:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100505.126161:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100506.150529:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100507.173873:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100508.198046:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790100508.902357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790100508.902367:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1790100509.223483:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100510.246071:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100511.271022:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100512.294790:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100512.616744:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100502/real 1790100502] req@ffff8d67b5a82680 x1877056126271744/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790100512 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100512.616777:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d67b5a82680 x1877056126271744/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790100512 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790100512.616795:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67b5cd2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790100512.616815:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1877056126271744:0@lo:39:umount.0 00000100:00080000:0.0:1790100512.617661:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790100512.617667:0:13286:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790100512.617673:0:13286:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790100512.618884:0:13286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100512.618901:0:13286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100512.618908:0:13286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100512.618916:0:13286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100512.618961:0:13286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100512.618968:0:13286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100512.618974:0:13286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100512.618981:0:13286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100512.618987:0:13286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100512.619082:0:13286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790100512.619087:0:13286:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1790100512.619109:0:13286:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1790100512.619113:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1790100512.619117:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790100512.619122:0:13286:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790100512.619128:0:13286:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d6787a2cd40) has no exports 00000020:00080000:0.0:1790100512.619205:0:13286:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d6787a2cd40) has no exports 00010000:00010000:2.0:1790100512.628349:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100512.628381:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100512.628393:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781657e00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100512.628398:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100512.628410:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100512.628419:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100512.628425:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100512.628429:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1790100512.628432:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1790100512.628452:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d6788c6c800 00010000:00010000:2.0:1790100512.628456:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100512.628464:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781657e00/0x31a8f3fdeeefcef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefcefb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100512.628489:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100512.628493:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100512.628499:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100512.628502:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100512.628518:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100512.628525:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100512.628530:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790100512.628532:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790100512.628534:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790100512.628540:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d6788c6c800 00010000:00010000:2.0:1790100512.628543:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100512.628549:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67ad819400/0x31a8f3fdeeefd139 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefd140 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100512.628768:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100512.628770:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100512.628772:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790100512.629903:0:13286:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d67bf99dea0 - data ffff8d67b07f7000/ffff8d67ad04b400 00000020:01000000:0.0:1790100512.630247:0:13286:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6784ea6360 - data ffff8d67a775ea20/ffff8d67bb956400 00010000:00010000:1.0:1790100512.633793:0:12981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1790100512.645187:0:13286:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790100512.676320:0:13286:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcdea 00000020:00000080:2.0:1790100512.676330:0:13286:0:(genops.c:885:class_export_put()) final put ffff8d6799f63000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1790100512.676352:0:13286:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6787677800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1790100512.676356:0:13286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6787677800 2 00000020:01000004:2.0:1790100512.676359:0:13286:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d6787677800 from lustre-OST0001 00000020:00000080:2.0:1790100512.676382:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100512.676391:0:13286:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1790100512.676394:0:13286:0:(genops.c:885:class_export_put()) final put ffff8d66811e5800/lustre-OST0001_UUID 00000020:00000080:2.0:1790100512.676397:0:13286:0:(genops.c:844:class_export_destroy()) destroying export ffff8d66811e5800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1790100512.676407:0:13286:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1790100512.676514:0:13286:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 44df9276-3139-4fbb-af61-ceba3e95d22a->MGS 00010000:00010000:2.0:1790100512.676539:0:13286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781522200/0x31a8f3fdeeefccee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefccf5 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100512.676551:0:13286:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781522200/0x31a8f3fdeeefccee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefccf5 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100512.676569:0:13286:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1790100512.676572:0:13286:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1790100512.676576:0:13286:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1790100512.676595:0:13286:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d6788c6c800 00010000:00010000:2.0:1790100512.676600:0:13286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781522200/0x31a8f3fdeeefccee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefccf5 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100512.676779:0:13286:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x31a8f3fdeeefcf41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100512.676788:0:13286:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x31a8f3fdeeefcf41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100512.676793:0:13286:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790100512.676796:0:13286:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1790100512.676797:0:13286:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1790100512.676810:0:13286:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d6788c6c800 00010000:00010000:2.0:1790100512.676812:0:13286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6781656600/0x31a8f3fdeeefcf3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x31a8f3fdeeefcf41 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790100512.676828:0:13286:0:(import.c:65:import_set_state_nolock()) ffff8d6788c6c800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1790100512.676832:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790100512.676835:0:13286:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790100512.676837:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790100512.676841:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790100512.676852:0:13286:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d67bf976680 x1877056126271616/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790100513 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790100512.676881:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790100512.676884:0:13286:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:1.0:1790100512.676954:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44df9276-3139-4fbb-af61-ceba3e95d22a:3310:1877056126271616:0@lo:250:kworker.0 00000020:00000080:0.0:1790100512.677024:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6799f63000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1790100512.677212:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790100512.677219:0:13286:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcbdd 00000020:00000080:2.0:1790100512.677224:0:13286:0:(genops.c:885:class_export_put()) final put ffff8d6788843800/44df9276-3139-4fbb-af61-ceba3e95d22a 00000020:01000000:2.0:1790100512.677237:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.118@tcp (flags='') 00000020:00000080:2.0:1790100512.677242:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100512.677247:0:13286:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.118@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790100512.677250:0:13286:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8d6784edb380) has no exports 00000020:00000080:0.0:1790100512.679102:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6788843800/44df9276-3139-4fbb-af61-ceba3e95d22a for MGC192.168.201.118@tcp 10000000:01000000:1.0:1790100512.683855:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1790100512.684029:0:13286:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.118@tcp: client import never connected 00000100:00080000:2.0:1790100512.684035:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1790100512.684043:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790100512.684210:0:13286:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1790100512.684214:0:13286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790100512.684690:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100512.684701:0:13286:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.118@tcp (uuid 44df9276-3139-4fbb-af61-ceba3e95d22a) 00000020:01000000:2.0:1790100512.684714:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790100512.684721:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100512.684727:0:13286:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790100512.684735:0:13286:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d67aee76800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790100512.684741:0:13286:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8d67bf9b4d40) has exports, disconnecting them 00000020:00080000:2.0:1790100512.684746:0:13286:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d67aee76800), last request at 1790100305 00000020:00000080:2.0:1790100512.684750:0:13286:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefce14 00000020:00080000:2.0:1790100512.684766:0:13286:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d67aee76800): rc 0 00000020:00000080:2.0:1790100512.684770:0:13286:0:(genops.c:885:class_export_put()) final put ffff8d67aee76800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790100512.685305:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d6788c6c800 for MGC192.168.201.118@tcp 00000020:00000080:0.0:1790100512.685314:0:36:0:(genops.c:885:class_export_put()) final put ffff8d6788840800/44df9276-3139-4fbb-af61-ceba3e95d22a 00000020:00000080:0.0:1790100512.685316:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6788840800/44df9276-3139-4fbb-af61-ceba3e95d22a for MGC192.168.201.118@tcp 00000020:01000000:0.0:1790100512.685323:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.118@tcp (44df9276-3139-4fbb-af61-ceba3e95d22a) 00000020:00000080:0.0:1790100512.685566:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67aee76800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790100512.692066:0:13286:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790100512.692075:0:13286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790100512.692080:0:13286:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790100512.692087:0:13286:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790100512.692150:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1790100512.692318:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d67b5cd2000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1790100512.705008:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1790100512.705235:0:12981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1790100512.705391:0:5825:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d67913dfe00:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1790100512.705435:0:5826:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d67913dec00:5826] 1 exiting: rc = 0 00000100:00100000:1.0:1790100512.705532:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.705800:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d67913dfa00:5828] 1 exiting: rc = 0 00000100:00100000:0.0:1790100512.705898:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d67913de600:5827] 0 exiting: rc = 1 00000100:00100000:0.0:1790100512.705954:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d67913dea00:5829] 2 exiting: rc = 0 00000100:00100000:2.0:1790100512.739765:0:12013:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d67b5ab7c00:12013] 3 exiting: rc = 0 00000100:00100000:1.0:1790100512.739945:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.739954:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.739961:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.739968:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.739985:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.739991:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.739997:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740004:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740010:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740015:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740020:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740027:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740033:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740038:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740045:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740051:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740058:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740064:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740069:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740074:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740080:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740085:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740090:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740095:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740100:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740105:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740109:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740115:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740120:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740124:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740129:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740135:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740140:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740144:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740149:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740366:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740372:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740378:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740383:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740394:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740399:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740405:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740411:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740416:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740421:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740426:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740431:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740437:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740441:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740446:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740451:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740456:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740461:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740466:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740471:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740476:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740481:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740486:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740490:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740495:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740500:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740504:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740510:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.740524:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790100512.742037:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790100512.742048:0:13286:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1790100512.742054:0:13286:0:(genops.c:885:class_export_put()) final put ffff8d67bf9ab800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1790100512.742058:0:13286:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67bf9ab800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1790100512.742066:0:13286:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1790100512.742105:0:13286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6787677800 1 00000020:00000080:1.0:1790100512.742110:0:13286:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x31a8f3fdeeefcdb9 00000020:00000080:1.0:1790100512.742116:0:13286:0:(genops.c:885:class_export_put()) final put ffff8d6787675800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1790100512.742136:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1790100512.742145:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790100512.742150:0:13286:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1790100512.742331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6787675800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00080000:1.0:1790100512.742358:0:13286:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8d6787ce8000) has no exports 00000020:00000080:2.0:1790100512.754709:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100512.754726:0:13286:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1790100512.754732:0:13286:0:(genops.c:885:class_export_put()) final put ffff8d6787676800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790100512.754748:0:13286:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6787676800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790100512.754755:0:13286:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1790100512.754928:0:13286:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d6787670000 00000020:01000000:2.0:1790100512.754950:0:13286:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1790100512.754954:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790100512.754959:0:13286:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790100512.754963:0:13286:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8d6787a2b380) has no exports 00000020:00000080:2.0:1790100512.754992:0:13286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790100512.754997:0:13286:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1790100512.755000:0:13286:0:(genops.c:885:class_export_put()) final put ffff8d67834eb800/OSS_uuid 00000020:00000080:2.0:1790100512.755002:0:13286:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67834eb800/OSS_uuid for OSS 00000020:01000000:2.0:1790100512.755006:0:13286:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1790100512.755140:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1790100512.755286:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8d6787d9f600:6690] 2 exiting: rc = 0 00000100:00100000:0.0:1790100512.755325:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8d6787d9e800:6689] 1 exiting: rc = 0 00000100:00100000:0.0:1790100512.755691:0:12004:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8d67bf367a00:12004] 3 exiting: rc = 0 00000100:00100000:0.0:1790100512.756670:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8d67ad0a3c00:6687] 0 exiting: rc = 1 00000100:00100000:2.0:1790100512.756782:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756797:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756806:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756812:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756818:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756824:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756829:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756835:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756840:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756846:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756851:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756856:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756862:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756867:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756873:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756878:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756884:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756889:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756894:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756899:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756904:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756909:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756934:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756939:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756945:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756950:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756955:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756960:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756965:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756970:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756975:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756980:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756984:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756989:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756994:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.756999:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757004:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757009:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757014:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757019:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757023:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757028:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757032:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757037:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757042:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757046:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757051:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757055:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757060:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757064:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757069:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757074:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757078:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757086:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757090:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757095:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757100:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757109:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757114:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757119:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757124:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757130:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757134:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.757140:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100512.757946:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d6799fd0400:6692] 1 exiting: rc = 0 00000100:00100000:0.0:1790100512.758673:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d67ad474a00:6691] 0 exiting: rc = 1 00000100:00100000:2.0:1790100512.758767:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758775:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758781:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758786:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758791:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758797:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758803:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758807:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758813:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758818:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758823:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758828:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758834:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758839:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758844:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758848:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758854:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758859:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758864:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758869:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758874:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758897:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758903:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758908:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758913:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758927:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758933:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758938:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758951:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758957:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758962:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758968:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758973:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758978:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758983:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758988:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758992:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.758998:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759003:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759008:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759012:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759017:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759022:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759027:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759032:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759036:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759041:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759046:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759051:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759055:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759060:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759064:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759069:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759074:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759079:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759083:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759088:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759092:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759097:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759101:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759106:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759111:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759115:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.759127:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100512.760165:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d67ad475c00:6695] 2 exiting: rc = 0 00000100:00100000:2.0:1790100512.760769:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d67ad474c00:6694] 1 exiting: rc = 0 00000100:00100000:3.0:1790100512.762410:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d67ad475000:6693] 0 exiting: rc = 1 00000100:00100000:2.0:1790100512.763266:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763274:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763280:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763286:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763291:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763297:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763303:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763309:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763314:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763321:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763327:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763333:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763339:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763344:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763350:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763355:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763360:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763366:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763371:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763389:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763395:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763401:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763406:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763412:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763418:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763423:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763428:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763433:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763439:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763444:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763449:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763455:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763461:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763476:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763481:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763486:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763492:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763498:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763504:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763760:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763770:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763775:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763781:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763800:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763806:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763811:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763816:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763822:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763827:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763833:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763838:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763844:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763850:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763855:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763860:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763865:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763871:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763875:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763881:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763886:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763891:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763897:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763903:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.763913:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790100512.772415:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d67ad511000:6696] 0 exiting: rc = 1 00000100:00100000:1.0:1790100512.772815:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d67ad510c00:6697] 1 exiting: rc = 0 00000100:00100000:2.0:1790100512.772905:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772914:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772930:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772936:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772951:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772957:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772963:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772969:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772974:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772980:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772986:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772991:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.772996:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773001:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773006:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773011:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773015:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773020:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773025:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773030:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773034:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773039:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773043:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773047:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773052:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773057:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773061:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773066:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773071:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773075:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773079:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773084:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773087:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773090:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773094:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773098:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773102:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773106:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773110:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773121:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773125:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773130:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773135:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773141:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773145:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773162:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773167:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773172:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773177:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773182:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773187:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773192:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773197:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773202:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773206:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773211:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773215:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773220:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773225:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773230:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773235:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773241:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773245:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.773252:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790100512.774343:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d67ad510e00:6699] 1 exiting: rc = 0 00000100:00100000:0.0:1790100512.774472:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d67ad511a00:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1790100512.774562:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774569:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774576:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774581:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774587:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774599:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774606:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774635:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774647:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774654:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774667:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774677:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774683:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774690:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774698:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774704:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774710:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774716:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774721:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774728:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774752:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774759:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774765:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774773:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774781:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774788:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774797:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774803:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774810:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774816:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774823:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774829:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774852:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774858:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774864:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774869:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774876:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774881:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774887:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774892:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774898:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774904:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774909:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774915:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774944:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774955:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774960:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774967:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774973:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774979:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774987:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.774994:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775000:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775006:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775011:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775018:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775035:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775041:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775048:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775054:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775060:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775066:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775071:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790100512.775076:0:13286:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1790100512.783347:0:13286:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1790100539.055017:0:13903:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790100549.856644:0:14363:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790100549.856649:0:14363:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790100549.856756:0:14363:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d6682507800 00000020:01000004:1.0:1790100549.856772:0:14363:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1790100549.856780:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790100549.856793:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d6784edb380) 00000020:00000080:1.0:1790100549.856806:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790100549.889957:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790100549.893285:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1790100549.900909:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790100549.901046:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 549: rc = 0 00100000:10000000:2.0:1790100549.901189:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 549: rc = 0 00100000:10000000:2.0:1790100549.901279:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 549: rc = 0 00100000:10000000:2.0:1790100549.901403:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 549: rc = 0 00100000:10000000:2.0:1790100549.901546:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 549: rc = 0 00100000:10000000:2.0:1790100549.902380:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 549: rc = 0 00100000:10000000:2.0:1790100549.902751:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 551: rc = 0 00100000:10000000:2.0:1790100549.905999:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 292: rc = 0 00100000:10000000:2.0:1790100549.906108:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 292: rc = 0 00100000:10000000:2.0:1790100549.907092:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 242: rc = 0 00100000:10000000:2.0:1790100549.907428:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 242: rc = 0 00100000:10000000:2.0:1790100549.907900:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 242: rc = 0 00100000:10000000:2.0:1790100549.908153:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 242: rc = 0 00100000:10000000:2.0:1790100549.908937:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 242: rc = 0 00100000:10000000:2.0:1790100549.909196:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 242: rc = 0 00100000:10000000:2.0:1790100549.909813:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 242: rc = 0 00100000:10000000:2.0:1790100549.910083:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 242: rc = 0 00100000:10000000:2.0:1790100549.910431:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 242: rc = 0 00100000:10000000:2.0:1790100549.911102:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 242: rc = 0 00100000:10000000:2.0:1790100549.911345:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 242: rc = 0 00100000:10000000:2.0:1790100549.911766:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 242: rc = 0 00100000:10000000:2.0:1790100549.912193:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 417: rc = 0 00100000:10000000:2.0:1790100549.912923:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 417: rc = 0 00100000:10000000:2.0:1790100549.913181:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 417: rc = 0 00100000:10000000:2.0:1790100549.913692:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 417: rc = 0 00100000:10000000:2.0:1790100549.913961:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 417: rc = 0 00100000:10000000:2.0:1790100549.914208:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 417: rc = 0 00100000:10000000:2.0:1790100549.917146:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 417: rc = 0 00100000:10000000:2.0:1790100549.917930:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 417: rc = 0 00100000:10000000:2.0:1790100549.918178:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 417: rc = 0 00100000:10000000:2.0:1790100549.918579:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 417: rc = 0 00100000:10000000:2.0:1790100549.918932:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 417: rc = 0 00100000:10000000:2.0:1790100549.919186:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 417: rc = 0 00100000:10000000:2.0:1790100549.920577:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 417: rc = 0 00100000:10000000:2.0:1790100549.920864:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 417: rc = 0 00100000:10000000:2.0:1790100549.921117:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 417: rc = 0 00100000:10000000:2.0:1790100549.921386:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 417: rc = 0 00100000:10000000:2.0:1790100549.921692:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 417: rc = 0 00100000:10000000:2.0:1790100549.921922:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 417: rc = 0 00100000:10000000:2.0:1790100549.922407:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 417: rc = 0 00100000:10000000:2.0:1790100549.922705:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 417: rc = 0 00100000:10000000:2.0:1790100549.922960:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 417: rc = 0 00100000:10000000:2.0:1790100549.923207:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 417: rc = 0 00100000:10000000:2.0:1790100549.923476:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 417: rc = 0 00100000:10000000:2.0:1790100549.923759:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 417: rc = 0 00100000:10000000:2.0:1790100549.924027:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 417: rc = 0 00100000:10000000:2.0:1790100549.924275:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 417: rc = 0 00100000:10000000:2.0:1790100549.924539:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 417: rc = 0 00100000:10000000:2.0:1790100549.924839:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 417: rc = 0 00100000:10000000:2.0:1790100549.925110:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 417: rc = 0 00100000:10000000:2.0:1790100549.927703:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 417: rc = 0 00100000:10000000:2.0:1790100549.927984:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 417: rc = 0 00100000:10000000:2.0:1790100549.928242:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 417: rc = 0 00100000:10000000:2.0:1790100549.932173:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 250: rc = 0 00100000:10000000:2.0:1790100549.933160:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790100549.936921:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 691: rc = 0 00100000:10000000:2.0:1790100549.937244:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790100549.937337:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 691: rc = 0 00100000:10000000:3.0:1790100549.940183:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1790100549.940304:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 691: rc = 0 00100000:10000000:3.0:1790100549.940971:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1790100549.941048:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 293: rc = 0 00100000:10000000:3.0:1790100549.941249:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1790100549.941340:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 293: rc = 0 00100000:10000000:3.0:1790100549.942235:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1790100549.942321:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 293: rc = 0 00000020:00000080:3.0:1790100549.944331:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790100549.944340:0:14363:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790100549.944364:0:14363:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefded0 00000020:01000004:3.0:1790100549.944373:0:14363:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790100549.944377:0:14363:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790100549.944382:0:14363:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d6682507800 from MGS 00000020:01000004:3.0:1790100549.944386:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790100549.944396:0:14363:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d67ad418000) 00000020:00000080:3.0:1790100549.944405:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790100549.944470:0:14363:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6682507800 from MGS, refs=2 00080000:01000000:3.0:1790100549.944475:0:14363:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790100549.944481:0:14363:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefdede 00000100:00100000:3.0:1790100549.944592:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790100549.944754:0:14363:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790100549.944760:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790100549.945942:0:14363:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790100549.945952:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790100549.946965:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100549.947131:0:14363:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790100549.947144:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790100549.949439:0:14363:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790100549.949460:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790100549.950008:0:14363:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790100549.950015:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790100549.957336:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100549.957342:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100549.957345:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100549.957908:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100549.957912:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100549.957913:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100549.958730:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790100549.961989:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790100549.972676:0:14363:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790100549.972697:0:14363:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790100549.972700:0:14363:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1790100549.976240:0:14373:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790100549.976448:0:14363:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790100549.976555:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790100549.977109:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790100549.977476:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100549.977666:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790100549.977673:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790100549.981829:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790100549.981845:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790100549.982523:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790100549.982531:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790100549.983455:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790100549.983476:0:14363:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.118@tcp' 00000020:01000004:1.0:1790100549.983477:0:14363:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790100549.983509:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.118@tcp (typ=mgc) 00000020:00000080:1.0:1790100549.983522:0:14363:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.118@tcp (ffff8d6784edcd40) 00000020:00000080:1.0:1790100549.983539:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790100549.983655:0:14363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d67834eb000@MGC192.168.201.118@tcp: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1790100549.983806:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.118@tcp-0 is initialized 00000040:01000000:1.0:1790100549.983811:0:14363:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790100549.984448:0:14377:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1790100549.989481:0:14378:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790100549.989694:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.118@tcp (uuid c14c9b5f-8de7-4b86-b0e7-559cbab51fe8) 00000020:00000080:1.0:1790100549.989721:0:14363:0:(genops.c:1384:class_connect()) connect: client c14c9b5f-8de7-4b86-b0e7-559cbab51fe8, cookie 0x31a8f3fdeeefdeec 00000100:00080000:1.0:1790100549.989736:0:14363:0:(import.c:545:import_select_connection()) MGC192.168.201.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790100549.989748:0:14363:0:(import.c:666:import_select_connection()) MGC192.168.201.118@tcp: import ffff8d67834eb000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1790100549.989788:0:14363:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67bf3fce00 x1877056126271872/t0(0) o250->MGC192.168.201.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100549.989815:0:14363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c14c9b5f-8de7-4b86-b0e7-559cbab51fe8->MGS 00000020:01000004:1.0:1790100549.989833:0:14363:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790100549.989838:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790100549.989851:0:14363:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d6784ed8000) 00000020:00000080:1.0:1790100549.989863:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790100549.993560:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3310:1877056126271872:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790100549.993686:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100549.998529:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126271872 00000100:00100000:3.0:1790100549.998547:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126271872 00000100:00100000:3.0:1790100549.998635:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790100549.998646:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6791358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1877056126271872:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1790100549.998684:0:14374:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c14c9b5f-8de7-4b86-b0e7-559cbab51fe8@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:3.0:1790100549.998721:0:14374:0:(genops.c:1384:class_connect()) connect: client c14c9b5f-8de7-4b86-b0e7-559cbab51fe8, cookie 0x31a8f3fdeeefdefa 00000100:00080000:3.0:1790100549.998892:0:14374:0:(import.c:65:import_set_state_nolock()) ffff8d67ae569800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100549.999004:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6791358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+5:3310:x1877056126271872:12345-0@lo:250:mount.lustre.0 Request processed in 357us (5316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100549.999012:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100549.999157:0:3310:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790100549.999170:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.118@tcp: connect to target with instance 0 00000100:00080000:2.0:1790100549.999196:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790100549.999203:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790100549.999207:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67834eb000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790100549.999211:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790100549.999227:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790100549.999234:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3310:1877056126271872:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790100550.009407:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100550.011664:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790100550.011673:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790100550.018766:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790100550.018781:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790100550.019368:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790100550.019375:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1790100550.020065:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100550.020256:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1790100550.020261:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790100550.020714:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790100550.020721:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790100550.090722:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100550.090946:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790100550.090953:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790100550.093486:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790100550.093507:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790100550.094597:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100550.094985:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790100550.094991:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790100550.099690:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790100550.099713:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1790100550.100397:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100550.100589:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790100550.100594:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790100550.101786:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790100550.101797:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790100550.102341:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100550.102508:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790100550.102513:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790100550.103013:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790100550.103021:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790100550.140212:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790100550.142251:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790100550.142266:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790100550.143696:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790100550.143709:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790100550.151233:0:14363:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790100550.151256:0:14363:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790100550.162699:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790100550.162866:0:14363:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790100550.162873:0:14363:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790100550.163018:0:14363:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790100550.163061:0:14363:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790100550.163066:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790100550.163068:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790100550.163069:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100550.163070:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100550.163071:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100550.163072:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100550.163074:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100550.163075:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790100550.163077:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100550.163078:0:14363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100550.163080:0:14363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790100550.163082:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100550.163083:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790100550.163084:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100550.163085:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100550.163086:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100550.163087:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100550.163088:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790100550.163089:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790100550.163090:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100550.163091:0:14363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100550.163118:0:14363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790100550.163138:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790100550.163205:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100550.163257:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bb5320c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100550.167154:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126272000 00000100:00100000:3.0:1790100550.167169:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126272000 00000100:00100000:3.0:1790100550.167238:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100550.167249:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6791359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+5:14363:x1877056126272000:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790100550.167328:0:14376:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790100550.167331:0:14376:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790100550.167334:0:14376:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1790100550.167873:0:14397:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790100550.168267:0:14376:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1790100550.169822:0:14398:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790100550.169829:0:14398:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790100550.169832:0:14398:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1790100550.169867:0:14398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1790100550.170183:0:14376:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790100550.170193:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790100550.184964:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6791359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+5:14363:x1877056126272000:12345-0@lo:253:mount.lustre.0 Request processed in 17706us (21747us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100550.184986:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100550.185075:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790100550.185095:0:14363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790100550.185098:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790100550.185101:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790100550.185102:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100550.185104:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100550.185105:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100550.185106:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100550.185107:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790100550.185109:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790100550.185111:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100550.185112:0:14363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790100550.185137:0:14363:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d6682507800 from lustre-MDT0000 10000000:01000000:1.0:1790100550.185172:0:14363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790100550.185176:0:14363:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790100550.185180:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d6784edcd40 10000000:01000000:1.0:1790100550.185185:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100550.185195:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d6784edcd40 from 1 10000000:01000000:1.0:1790100550.185198:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790100550.185240:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.185253:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.185265:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100550.185298:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790100550.185416:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100550.185598:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67834890c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100550.185787:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126272128 00000100:00100000:2.0:1790100550.185793:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126272128 00000100:00100000:2.0:1790100550.185831:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100550.185839:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+5:14363:x1877056126272128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100550.185851:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100550.185867:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6785142600/0x31a8f3fdeeefdf08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefdf01 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100550.185889:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6785142600/0x31a8f3fdeeefdf08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdf01 expref: 6 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100550.185900:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6785142600/0x31a8f3fdeeefdf08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdf01 expref: 6 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100550.185908:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142600, rc 0) 00000100:00100000:2.0:1790100550.185950:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+6:14363:x1877056126272128:12345-0@lo:101:mount.lustre.0 Request processed in 111us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100550.185956:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100550.186030:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100550.186044:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.186052:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100550.186098:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100550.186122:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.186147:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2721240 going to sleep for 11 seconds 00000100:00100000:2.0:1790100550.186187:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126272256 00000100:00100000:2.0:1790100550.186191:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126272256 00000100:00100000:2.0:1790100550.186217:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100550.186222:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+6:14363:x1877056126272256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100550.186431:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+6:14363:x1877056126272256:12345-0@lo:501:mount.lustre.0 Request processed in 207us (307us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100550.186544:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272256:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790100550.186573:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790100550.186590:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.186598:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100550.186606:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d6682507800 10000000:01000000:0.0:1790100550.186643:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790100550.186648:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d6682507800 10000000:01000000:0.0:1790100550.186676:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790100550.186680:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d6682507800 from 1 10000000:01000000:0.0:1790100550.186682:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790100550.186702:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819a00/0x31a8f3fdeeefdf0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.186710:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67ad819a00/0x31a8f3fdeeefdf0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.186719:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67ad819a00/0x31a8f3fdeeefdf0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100550.186731:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790100550.186753:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.186784:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126272384 00000100:00100000:0.0:1790100550.186788:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126272384 00000100:00100000:0.0:1790100550.186804:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100550.186809:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+7:14363:x1877056126272384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100550.186816:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100550.186825:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad818a00/0x31a8f3fdeeefdf16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefdf0f expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.186848:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad818a00/0x31a8f3fdeeefdf16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdf0f expref: 8 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.186856:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad818a00/0x31a8f3fdeeefdf16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdf0f expref: 8 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.186863:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818a00, rc 0) 00000100:00100000:0.0:1790100550.186884:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+8:14363:x1877056126272384:12345-0@lo:101:mount.lustre.0 Request processed in 75us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.186890:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100550.186909:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2721240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.186918:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100550.186928:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67ad819a00/0x31a8f3fdeeefdf0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf16 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.186935:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67ad819a00/0x31a8f3fdeeefdf0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefdf16 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100550.186945:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790100550.186949:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819a00/0x31a8f3fdeeefdf0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf16 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.186956:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67ad819a00/0x31a8f3fdeeefdf0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf16 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100550.186962:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790100550.186965:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790100550.186974:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d6682507800 10000000:01000000:0.0:1790100550.186977:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790100550.186980:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1790100550.186982:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790100550.186994:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819200/0x31a8f3fdeeefdf1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.187001:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67ad819200/0x31a8f3fdeeefdf1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.187008:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67ad819200/0x31a8f3fdeeefdf1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100550.187018:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790100550.187043:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.187061:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126272512 00000100:00100000:0.0:1790100550.187064:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126272512 00000100:00100000:0.0:1790100550.187078:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100550.187083:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+8:14363:x1877056126272512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100550.187088:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100550.187095:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad818800/0x31a8f3fdeeefdf24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefdf1d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.187107:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad818800/0x31a8f3fdeeefdf24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdf1d expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.187115:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad818800/0x31a8f3fdeeefdf24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdf1d expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.187121:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818800, rc 0) 00000100:00100000:0.0:1790100550.187147:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+9:14363:x1877056126272512:12345-0@lo:101:mount.lustre.0 Request processed in 64us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.187152:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100550.187170:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b2721240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.187179:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100550.187188:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67ad819200/0x31a8f3fdeeefdf1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf24 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.187195:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67ad819200/0x31a8f3fdeeefdf1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefdf24 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100550.187225:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100550.187244:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.187258:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126272640 00000100:00100000:0.0:1790100550.187260:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126272640 00000100:00100000:0.0:1790100550.187272:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100550.187277:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+9:14363:x1877056126272640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100550.187657:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+10:14363:x1877056126272640:12345-0@lo:501:mount.lustre.0 Request processed in 378us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.187664:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790100550.187689:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67811ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.187702:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100550.187727:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100550.187766:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.187787:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126272768 00000100:00100000:0.0:1790100550.187792:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126272768 00000100:00100000:0.0:1790100550.187815:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790100550.187820:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+10:14363:x1877056126272768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100550.188079:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+10:14363:x1877056126272768:12345-0@lo:503:mount.lustre.0 Request processed in 258us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.188087:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790100550.188116:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67811ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.188129:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126272768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790100550.188526:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100550.189803:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14399:1877056126272896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100550.189864:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100550.189929:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6792a37180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.189958:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126272896 00000100:00100000:0.0:1790100550.189965:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126272896 00000100:00100000:0.0:1790100550.190033:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790100550.190042:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+9:14399:x1877056126272896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100550.190654:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+9:14399:x1877056126272896:12345-0@lo:502:llog_process_th.0 Request processed in 612us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.190663:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790100550.190863:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14399:1877056126272896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790100550.190890:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100550.190902:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100550.190905:0:14399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790100550.190912:0:14399:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790100550.190914:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790100550.190935:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d67ad41cd40) 00000020:00000080:3.0:1790100550.190956:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790100550.190962:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790100550.191041:0:14399:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790100550.191050:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefdf32 00000020:00000080:3.0:1790100550.191263:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790100550.191268:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100550.191271:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100550.191273:0:14399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790100550.191275:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100550.191279:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100550.191280:0:14399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790100550.191283:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790100550.191303:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d67ad4199c0) 00000020:00000080:3.0:1790100550.191314:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790100550.191318:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790100550.191320:0:14399:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790100550.191322:0:14399:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790100550.191329:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790100550.191585:0:14399:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6682507800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790100550.191602:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d67ad41b380) 00000020:00000080:3.0:1790100550.191686:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790100550.191748:0:14399:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790100550.191893:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefdf47 00000020:00000080:3.0:1790100550.191991:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790100550.191998:0:14399:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790100550.192002:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x31a8f3fdeeefdf4e 00080000:01000000:3.0:1790100550.192007:0:14399:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790100550.192010:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefdf55 00010000:00010000:3.0:1790100550.286848:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790100550.287410:0:14399:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1790100550.287831:0:14399:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790100550.288706:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d67af04cd40) 00000020:00000080:3.0:1790100550.288738:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790100550.288827:0:14399:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790100550.288836:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefdf63 00000020:00000080:3.0:1790100550.290463:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790100550.298309:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x31a8f3fdeeefdf6a 00000020:00000080:0.0:1790100550.307764:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790100550.307780:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100550.307788:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.307791:0:14399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790100550.307795:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790100550.307798:0:14399:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1790100550.307800:0:14399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100550.307801:0:14399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100550.307803:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790100550.307806:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.307807:0:14399:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790100550.307809:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100550.307814:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.307815:0:14399:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790100550.307819:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790100550.307872:0:14399:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790100550.307893:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100550.307896:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.307898:0:14399:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790100550.307900:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790100550.307904:0:14399:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790100550.307907:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.307908:0:14399:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790100550.307911:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790100550.307916:0:14399:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:0.0:1790100550.307941:0:14399:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790100550.307944:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100550.307959:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d6787a299c0) 00000020:00000080:0.0:1790100550.307977:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1790100550.307982:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790100550.308037:0:14399:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790100550.308043:0:14399:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790100550.308051:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefdf78 00010000:00080000:0.0:1790100550.308086:0:14399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d66811e3000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1790100550.308323:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1790100550.312228:0:14399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790100550.312279:0:14399:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790100550.313277:0:14399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100550.313351:0:14399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1790100550.313424:0:14399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1790100550.321868:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790100550.321876:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790100550.325600:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790100550.325649:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790100550.325693:0:14399:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790100550.325715:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefdf7f 00000100:00080000:0.0:1790100550.325739:0:14399:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100550.325753:0:14399:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d66811e3000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100550.325798:0:14399:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67b5a80380 x1877056126273024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100550.325824:0:14399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790100550.325883:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100550.325887:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.325889:0:14399:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790100550.325891:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790100550.325894:0:14399:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790100550.325895:0:14399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100550.325897:0:14399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790100550.325898:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790100550.325900:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.325901:0:14399:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790100550.325905:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790100550.325910:0:14399:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790100550.325913:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.325914:0:14399:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790100550.325917:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790100550.325921:0:14399:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.118@tcp to nid 0x20000c0a8c976 (192.168.201.118@tcp) 00000020:01000000:0.0:1790100550.325942:0:14399:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790100550.325944:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100550.325956:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d6787a2b380) 00000020:00000080:0.0:1790100550.325969:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1790100550.325973:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790100550.326021:0:14399:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1790100550.326041:0:14399:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1790100550.326048:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x31a8f3fdeeefdf8d 00010000:00080000:0.0:1790100550.326075:0:14399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d678a4bf000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1790100550.326267:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1790100550.326488:0:14399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790100550.326510:0:14399:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790100550.327178:0:14399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100550.327250:0:14399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1790100550.327341:0:14399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1790100550.327600:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126273024:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790100550.327673:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056126273024 offset 0 length 520: 4 00000040:00080000:0.0:1790100550.334408:0:14405:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790100550.334416:0:14405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790100550.335355:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790100550.335370:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790100550.335406:0:14399:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790100550.335427:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefdf94 00000100:00080000:0.0:1790100550.335439:0:14399:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100550.335450:0:14399:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d678a4bf000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100550.335492:0:14399:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67b5a80e00 x1877056126273152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790100550.336042:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126273152:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790100550.336100:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056126273152 offset 0 length 520: 4 00000100:00080000:0.0:1790100550.336237:0:14399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790100550.336375:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100550.336380:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.336383:0:14399:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790100550.336386:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100550.336391:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.336393:0:14399:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790100550.336396:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790100550.336398:0:14399:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790100550.336400:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100550.336402:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.336403:0:14399:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790100550.336405:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790100550.336408:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.336409:0:14399:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790100550.336413:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790100550.336447:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14399:1877056126273280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100550.336587:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.336633:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100550.336790:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126273280 00000100:00100000:3.0:1790100550.336800:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126273280 00000100:00100000:3.0:1790100550.336850:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100550.336860:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+9:14399:x1877056126273280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100550.337133:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+9:14399:x1877056126273280:12345-0@lo:502:llog_process_th.0 Request processed in 274us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100550.337141:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790100550.339724:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14399:1877056126273280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790100550.339784:0:14399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790100550.339796:0:14399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100550.339798:0:14399:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790100550.339802:0:14399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790100550.340037:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1790100550.340065:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790100550.340083:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819200/0x31a8f3fdeeefdf1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf24 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100550.340095:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67ad819200/0x31a8f3fdeeefdf1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf24 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100550.340105:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6682507800 from 1 10000000:01000000:2.0:1790100550.340107:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790100550.340153:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100550.340161:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100550.340170:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100550.340198:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790100550.340280:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100550.340336:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bb532180 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.340731:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126273408 00000100:00100000:0.0:1790100550.340741:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126273408 00000100:00100000:0.0:1790100550.340791:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100550.340801:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+9:14363:x1877056126273408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100550.340815:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100550.340828:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefdf9b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.340854:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdf9b expref: 10 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.340864:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdf9b expref: 10 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.340871:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819000, rc 0) 00000100:00100000:0.0:1790100550.340912:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+10:14363:x1877056126273408:12345-0@lo:101:mount.lustre.0 Request processed in 112us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.340919:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100550.341037:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100550.341050:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100550.341059:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100550.346986:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273536:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790100550.347084:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100550.347133:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7300 going to sleep for 11 seconds 00000100:00100000:2.0:1790100550.347725:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126273536 00000100:00100000:2.0:1790100550.347745:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126273536 00000100:00100000:2.0:1790100550.347801:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790100550.347811:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+10:14363:x1877056126273536:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790100550.347834:0:14376:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790100550.347841:0:14376:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790100550.347927:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+10:14363:x1877056126273536:12345-0@lo:256:mount.lustre.0 Request processed in 117us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100550.347935:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790100550.348024:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273536:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790100550.348700:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790100550.348718:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.348730:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100550.348751:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6682507800 from 1 10000000:01000000:3.0:1790100550.348755:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100550.348789:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.348796:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.348805:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100550.348825:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790100550.348863:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100550.348898:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126273664 00000100:00100000:3.0:1790100550.348903:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126273664 00000100:00100000:3.0:1790100550.348936:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100550.348944:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+10:14363:x1877056126273664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100550.348954:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100550.348968:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefdfa9 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.348992:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdfa9 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.349003:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdfa9 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.349012:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900aee00, rc 0) 00000100:00100000:3.0:1790100550.349048:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14363:x1877056126273664:12345-0@lo:101:mount.lustre.0 Request processed in 105us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100550.349056:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100550.349097:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100550.349113:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100550.349125:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.349134:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100550.349183:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100550.349208:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100550.349228:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126273792 00000100:00100000:3.0:1790100550.349232:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126273792 00000100:00100000:3.0:1790100550.349253:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100550.349258:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14363:x1877056126273792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100550.349691:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14363:x1877056126273792:12345-0@lo:501:mount.lustre.0 Request processed in 431us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100550.349698:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790100550.349729:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100550.349742:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100550.349769:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100550.349806:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100550.349826:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126273920 00000100:00100000:3.0:1790100550.349831:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126273920 00000100:00100000:3.0:1790100550.349861:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790100550.349866:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14363:x1877056126273920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100550.349989:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14363:x1877056126273920:12345-0@lo:503:mount.lustre.0 Request processed in 122us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100550.349996:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790100550.350025:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100550.350038:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126273920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100550.354746:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14407:1877056126274048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100550.354847:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100550.354898:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.354976:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126274048 00000100:00100000:0.0:1790100550.354986:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126274048 00000100:00100000:0.0:1790100550.355049:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790100550.355060:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14407:x1877056126274048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100550.355360:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14407:x1877056126274048:12345-0@lo:502:llog_process_th.0 Request processed in 302us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.355368:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100550.355746:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14407:1877056126274048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100550.355780:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100550.355792:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100550.355794:0:14407:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790100550.355804:0:14407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6682507800 00000020:00000080:2.0:1790100550.355806:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790100550.355816:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100550.355819:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100550.355820:0:14407:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790100550.355823:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100550.355825:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100550.355826:0:14407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790100550.355830:0:14407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6682507800 00000020:00000080:2.0:1790100550.355833:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790100550.355891:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100550.355895:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100550.355896:0:14407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790100550.355898:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100550.355901:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100550.355902:0:14407:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790100550.355905:0:14407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6682507800 00000020:00000080:2.0:1790100550.355907:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790100550.355950:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14407:1877056126274176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790100550.356000:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.356126:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126274176 00000100:00100000:0.0:1790100550.356132:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126274176 00000100:00100000:0.0:1790100550.356174:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790100550.356182:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14407:x1877056126274176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100550.356347:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14407:x1877056126274176:12345-0@lo:502:llog_process_th.0 Request processed in 166us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.356354:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790100550.356416:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bb5320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100550.356432:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14407:1877056126274176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790100550.356453:0:14407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100550.356457:0:14407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100550.356458:0:14407:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790100550.356462:0:14407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790100550.375715:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790100550.375753:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790100550.375780:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.375796:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100550.375968:0:14363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790100550.375973:0:14363:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d6682507800 10000000:01000000:1.0:1790100550.375975:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d6682507800 10000000:01000000:1.0:1790100550.375983:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100550.375991:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6682507800 from 1 10000000:01000000:1.0:1790100550.375995:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100550.376037:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefdfb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.376047:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefdfb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.376061:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefdfb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100550.376087:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126274304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790100550.376162:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100550.376216:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6783489b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.376417:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126274304 00000100:00100000:0.0:1790100550.376425:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126274304 00000100:00100000:0.0:1790100550.376480:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790100550.376489:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14363:x1877056126274304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100550.376507:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100550.376656:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad819800/0x31a8f3fdeeefdfbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefdfb7 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.376682:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad819800/0x31a8f3fdeeefdfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdfb7 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.376708:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad819800/0x31a8f3fdeeefdfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdfb7 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.376717:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819800, rc 0) 00000100:00100000:0.0:1790100550.376767:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14363:x1877056126274304:12345-0@lo:101:mount.lustre.0 Request processed in 278us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.376774:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790100550.376862:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126274304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100550.376876:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefdfb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfbe expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.376886:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefdfb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefdfbe expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100550.376954:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126274432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100550.376984:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100550.377016:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6783489b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.377242:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126274432 00000100:00100000:0.0:1790100550.377249:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126274432 00000100:00100000:0.0:1790100550.377291:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790100550.377299:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14363:x1877056126274432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100550.380066:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14363:x1877056126274432:12345-0@lo:501:mount.lustre.0 Request processed in 2757us (3069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.380078:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790100550.382262:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126274432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100550.382363:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126274560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100550.382452:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.382493:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.385386:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126274560 00000100:00100000:0.0:1790100550.385406:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126274560 00000100:00100000:0.0:1790100550.385499:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790100550.385511:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14363:x1877056126274560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100550.387023:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14363:x1877056126274560:12345-0@lo:503:mount.lustre.0 Request processed in 1510us (4568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.387048:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790100550.387141:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126274560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100550.393536:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14411:1877056126274688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100550.393643:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.393680:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126274688 00000100:00100000:0.0:1790100550.393688:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126274688 00000100:00100000:0.0:1790100550.393729:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790100550.393738:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14411:x1877056126274688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100550.393983:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14411:x1877056126274688:12345-0@lo:502:llog_process_th.0 Request processed in 245us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.393991:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790100550.394045:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b042c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.394068:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14411:1877056126274688:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1790100550.394133:0:14411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790100550.394147:0:14411:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d6787a2cd40) 00000020:00000080:0.0:1790100550.394166:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1790100550.394243:0:14411:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6682507800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790100550.394247:0:14411:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6682507800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790100550.394250:0:14411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6682507800 4 00010000:00080000:0.0:1790100550.402122:0:14411:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6787a06000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1790100550.405167:0:14411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1790100550.405905:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790100550.405945:0:14411:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790100550.405959:0:14411:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x31a8f3fdeeefdfcc 00000100:00080000:0.0:1790100550.405971:0:14411:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100550.405983:0:14411:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d6787a06000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100550.406021:0:14411:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67b5a82a00 x1877056126274816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100550.406080:0:14411:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790100550.409181:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126274816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790100550.409268:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100550.411186:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126274816 00000100:00100000:2.0:1790100550.411201:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126274816 00000100:00100000:2.0:1790100550.411256:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100550.411265:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1877056126274816:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790100550.411372:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1877056126274816:12345-0@lo:38:llog_process_th.0 Request processed in 106us (2103us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790100550.411379:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100550.412795:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a81c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14411:1877056126274944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790100550.412866:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.412903:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b042cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100550.414221:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100550.414232:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d6787a06000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790100550.414237:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790100550.414241:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126274816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790100550.414272:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126274944 00000100:00100000:3.0:1790100550.414280:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126274944 00000100:00100000:3.0:1790100550.414348:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790100550.414357:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14411:x1877056126274944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790100550.415637:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14411:x1877056126274944:12345-0@lo:502:llog_process_th.0 Request processed in 1274us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100550.415650:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790100550.415715:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a81c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14411:1877056126274944:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790100550.415746:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790100550.415811:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1790100550.415830:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790100550.415857:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefdfb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfbe expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100550.415868:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13c00/0x31a8f3fdeeefdfb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfbe expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790100550.415917:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790100550.415919:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790100550.415921:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100550.415922:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100550.415923:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100550.415925:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100550.415926:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790100550.415927:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790100550.415929:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100550.415931:0:14363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790100550.415934:0:14363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1790100550.415936:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790100550.415938:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790100550.415939:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100550.415940:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100550.415941:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100550.415942:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100550.415947:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790100550.415948:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790100550.415949:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100550.415950:0:14363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790100550.415968:0:14363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790100550.415984:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a81c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126275072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790100550.416022:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100550.416050:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b042cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100550.416066:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126275072 00000100:00100000:0.0:1790100550.416072:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126275072 00000100:00100000:0.0:1790100550.416103:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790100550.416110:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14363:x1877056126275072:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790100550.416138:0:14376:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790100550.416152:0:14376:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790100550.504395:0:14376:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790100550.504433:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790100550.506449:0:14397:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790100550.506461:0:14397:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790100550.506505:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.506532:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdf9b expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.506542:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.506588:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefdf9b expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.506604:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdf9b expref: 12 pid: 14375 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100550.506654:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1877056126275200:0@lo:104: 00000100:00100000:3.0:1790100550.506731:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100550.507690:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788d563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100550.507812:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126275200 00000100:00100000:1.0:1790100550.507822:0:14365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126275200 00000100:00100000:1.0:1790100550.507875:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100550.507885:0:14365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:14397:x1877056126275200:12345-0@lo:104: 00010000:00010000:1.0:1790100550.507901:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.507993:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790100550.508000:0:14365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:14397:x1877056126275200:12345-0@lo:104: Request processed in 117us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100550.508006:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790100550.508044:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100550.508050:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508058:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143c00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100550.508062:0:14371:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508071:0:14371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100550.508077:0:14371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100550.508082:0:14371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790100550.508116:0:14371:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508135:0:14371:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100550.508156:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508162:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d6785143c00/0x31a8f3fdeeefdf9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdfa2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508179:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100550.508181:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100550.508183:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100550.508213:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126275328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100550.508251:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100550.508322:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126275328 00000100:00100000:1.0:1790100550.508327:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126275328 00010000:00010000:1.0:1790100550.508346:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdf9b expref: 13 pid: 14375 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100550.508367:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100550.508373:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+13:3312:x1877056126275328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790100550.508383:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100550.508388:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdf9b expref: 13 pid: 14375 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508398:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdf9b expref: 13 pid: 14375 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508417:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508437:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790100550.508452:0:14367:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001992013s 00010000:00010000:1.0:1790100550.508457:0:14367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508463:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508469:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508476:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508482:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100550.508485:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508737:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508749:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100550.508760:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100550.508795:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+13:3312:x1877056126275328:12345-0@lo:103:ldlm_bl.0 Request processed in 422us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100550.508802:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100550.508847:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126275328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100550.509434:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67ad819000/0x31a8f3fdeeefdfa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefdf9b expref: 12 pid: 14375 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100550.509449:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1877056126275200:0@lo:104: 00010000:00010000:3.0:1790100550.509466:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.509476:0:14397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.509483:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100550.509489:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67900ae400/0x31a8f3fdeeefdfd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100550.523889:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14363:x1877056126275072:12345-0@lo:253:mount.lustre.0 Request processed in 107769us (107855us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100550.523905:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100550.525541:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a81c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14363:1877056126275072:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790100550.525560:0:14363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790100550.525564:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790100550.525566:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790100550.525568:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100550.525569:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100550.525571:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100550.525572:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100550.525574:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790100550.525576:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790100550.525577:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100550.525578:0:14363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790100550.525594:0:14363:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790100550.542874:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790100550.543062:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790100550.543361:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790100550.543521:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790100550.543826:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790100550.543990:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790100550.552433:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790100550.553269:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790100550.554308:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1790100550.555587:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790100550.555960:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1790100550.556128:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1790100550.614768:0:14363:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1790100550.615350:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790100550.615428:0:14419:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1790100550.615433:0:14419:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1790100550.615745:0:14420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1790100550.615819:0:14420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100550.619123:0:14420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790100550.619242:0:14420:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790100550.619247:0:14420:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1790100550.624488:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790100550.624645:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790100550.625047:0:14363:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790100550.625055:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790100550.625180:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790100550.626186:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790100550.626742:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790100550.626768:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1790100550.635856:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1790100550.650203:0:14363:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790100550.776979:0:14363:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790100550.777028:0:14363:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb05f81c83988 00100000:10000000:1.0:1790100550.777037:0:14363:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790100550.778069:0:14363:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790100550.778087:0:14363:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790100550.778101:0:14363:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790100550.778117:0:14363:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1790100551.022307:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100551.464382:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1790100551.654932:0:14378:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790100551.654940:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6682507800 from 6 10000000:01000000:1.0:1790100551.654945:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790100551.654996:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100551.655009:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100551.655038:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100551.655068:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126275456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790100551.655144:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100551.655209:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67884db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100551.655272:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126275456 00000100:00100000:0.0:1790100551.655282:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126275456 00000100:00100000:0.0:1790100551.655349:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790100551.655359:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14378:x1877056126275456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100551.655373:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100551.655396:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefdfda expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100551.655420:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdfda expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100551.655430:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdfda expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100551.655450:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819c00, rc 0) 00000100:00100000:0.0:1790100551.655489:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14378:x1877056126275456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100551.655507:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790100551.655737:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126275456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100551.655753:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100551.655762:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100551.655817:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126275584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790100551.655850:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100551.655867:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67884db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100551.655925:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126275584 00000100:00100000:0.0:1790100551.655930:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126275584 00000100:00100000:0.0:1790100551.655962:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790100551.655969:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14378:x1877056126275584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790100551.655982:0:14376:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790100551.655999:0:14376:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790100551.656002:0:14376:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1790100551.656075:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14378:x1877056126275584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100551.656082:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790100551.656147:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126275584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790100551.656191:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790100551.656198:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100551.656206:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100552.044963:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790100552.490669:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790100553.066729:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100554.085795:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100555.119421:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100555.499297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100555.499305:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790100555.499309:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100555.499311:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790100555.499314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790100555.499317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790100555.499322:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d6787a06000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790100555.499341:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d6787a06000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:3.0:1790100555.499366:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67bf974700 x1877056126275840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790100555.499398:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126275840:0@lo:38:kworker.0 00000100:00100000:3.0:1790100555.499484:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100555.499575:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126275840 00000100:00100000:3.0:1790100555.499583:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126275840 00000100:00100000:3.0:1790100555.499636:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100555.499644:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1877056126275840:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1790100555.499670:0:14383:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:3.0:1790100555.499711:0:14383:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x31a8f3fdeeefdfe8 00000004:00100000:3.0:1790100555.499726:0:14383:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790100555.499886:0:14383:0:(import.c:65:import_set_state_nolock()) ffff8d6799ea1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100555.500412:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877056126275840:12345-0@lo:38:kworker.0 Request processed in 766us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100555.500421:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790100555.500470:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d67bf974700 x1877056126275840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790100555.500485:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790100555.500492:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790100555.500496:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790100555.500498:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d6787a06000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790100555.500504:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877056126275840:0@lo:38:kworker.0 00000100:00100000:0.0:1790100555.500632:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126275712:0@lo:400:kworker.0 00000100:00100000:0.0:1790100555.500670:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100555.500727:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126275712 00000100:00100000:0.0:1790100555.500745:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126275712 00000100:00100000:0.0:1790100555.500789:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100555.500797:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:3313:x1877056126275712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100555.500836:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:3313:x1877056126275712:12345-0@lo:400:kworker.0 Request processed in 40us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100555.500843:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790100555.500876:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126275712:0@lo:400:kworker.0 00010000:00010000:1.0:1790100556.149368:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790100556.421956:0:14662:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790100557.160810:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100558.181768:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100559.212902:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790100559.856437:0:14813:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0d29ba90 20000000:00000080:1.0:1790100559.856466:0:14813:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d67af321c00 uarg=0000000000000000 20000000:01000000:1.0:1790100559.856514:0:14813:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790100559.856524:0:14813:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790100559.856531:0:14813:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790100559.858929:0:14814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1790100559.859175:0:14813:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790100559.866232:0:14813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790100559.866293:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100559.866321:0:14813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdfa9 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100559.866330:0:14813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100559.866510:0:14813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefdfa9 expref: 11 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100559.866529:0:14813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfa9 expref: 11 pid: 14374 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100559.866548:0:14813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14813:1877056126275968:0@lo:104: 00000100:00100000:1.0:1790100559.867096:0:14813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100559.867191:0:14813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100559.867306:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126275968 00000100:00100000:2.0:1790100559.867318:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126275968 00000100:00100000:2.0:1790100559.867394:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100559.867406:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:14813:x1877056126275968:12345-0@lo:104: 00010000:00010000:2.0:1790100559.867422:0:14366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.867511:0:14366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100559.867518:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:14813:x1877056126275968:12345-0@lo:104: Request processed in 115us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100559.867525:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1790100559.867553:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100559.867560:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.867569:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100559.867573:0:14371:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.867583:0:14371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100559.867592:0:14371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100559.867658:0:14371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790100559.867701:0:14371:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.867708:0:14371:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100559.867736:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.867743:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67900ae600/0x31a8f3fdeeefdfa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdfb0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.867765:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100559.867767:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100559.867768:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100559.868000:0:14813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14813:1877056126275968:0@lo:104: 00010000:00010000:3.0:1790100559.868029:0:14813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100559.868715:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100559.868736:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126276096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100559.868817:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100559.868952:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126276096 00000100:00100000:2.0:1790100559.868963:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126276096 00010000:00010000:2.0:1790100559.869003:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfa9 expref: 12 pid: 14374 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100559.869071:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100559.869082:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:3313:x1877056126276096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100559.869102:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100559.869109:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfa9 expref: 12 pid: 14374 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869134:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfa9 expref: 12 pid: 14374 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869155:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67900aee00/0x31a8f3fdeeefdfb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfa9 expref: 12 pid: 14374 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869194:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869204:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869226:0:14367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869235:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869244:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869253:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869259:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12c00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100559.869264:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869285:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869306:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100559.869321:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100559.869379:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:3313:x1877056126276096:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100559.869394:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790100559.869477:0:14813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100559.869487:0:14813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100559.869500:0:14813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67b5e12c00/0x31a8f3fdeeefdfef lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100559.871096:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126276096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100560.229762:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100560.614958:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100550/real 1790100550] req@ffff8d67b5a80e00 x1877056126273152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100560 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100560.615002:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d67b5a80e00 x1877056126273152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100560 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100560.615015:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100550/real 1790100550] req@ffff8d67b5a80380 x1877056126273024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100560 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100560.615028:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d67b5a80380 x1877056126273024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100560 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790100560.615054:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100560.615071:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790100560.615076:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126273152:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790100560.615083:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d66811e3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100560.615088:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790100560.615090:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126273024:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790100560.619519:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100560.619529:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790100560.619534:0:487:0:(import.c:65:import_set_state_nolock()) ffff8d66811e3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100560.619544:0:487:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1790100560.619551:0:487:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790100560.619567:0:487:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d66811e3000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100560.619606:0:487:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67b5a82680 x1877056126276352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100560.619667:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100560.619670:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790100560.619672:0:487:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100560.619676:0:487:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1790100560.619678:0:487:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790100560.619687:0:487:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d678a4bf000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100560.619698:0:487:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67b5a83480 x1877056126276480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100560.619740:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126276608:0@lo:400:kworker.0 00000100:00100000:0.0:1790100560.619836:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100560.619926:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100560.619932:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126276224:0@lo:400:kworker.0 00000100:00100000:0.0:1790100560.619993:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100560.620077:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126276608 00000100:00100000:0.0:1790100560.620089:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126276608 00000100:00100000:0.0:1790100560.620165:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100560.620176:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126276608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100560.620255:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126276608:12345-0@lo:400:kworker.0 Request processed in 80us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100560.620264:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790100560.620298:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126276224 00000100:00100000:0.0:1790100560.620302:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126276224 00000100:00100000:0.0:1790100560.620329:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790100560.620336:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:3312:x1877056126276224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100560.620367:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:3312:x1877056126276224:12345-0@lo:400:kworker.0 Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100560.620373:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790100560.620416:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126276352:0@lo:8:kworker.0 00000400:00000100:0.0:1790100560.620445:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056126276352 offset 0 length 520: 4 00000100:00100000:0.0:1790100560.620458:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126276480:0@lo:8:kworker.0 00000400:00000100:0.0:1790100560.620478:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877056126276480 offset 0 length 520: 4 00000100:00100000:0.0:1790100560.620517:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126276224:0@lo:400:kworker.0 00010000:00080000:0.0:1790100560.620531:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d67b5a82300 x1877056126276608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100560.620544:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126276608:0@lo:400:kworker.0 00010000:00010000:2.0:1790100561.259257:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790100561.259963:0:14378:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790100561.259970:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6682507800 from 10 10000000:01000000:3.0:1790100561.259977:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100561.260042:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100561.260059:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100561.260074:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100561.260125:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126276736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100561.260221:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100561.260293:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf4da000 going to sleep for 11 seconds 00000100:00100000:0.0:1790100561.260654:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126276736 00000100:00100000:0.0:1790100561.260679:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126276736 00000100:00100000:0.0:1790100561.260763:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790100561.260787:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+11:14378:x1877056126276736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100561.260814:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100561.260836:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefdff6 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100561.260876:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdff6 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100561.260892:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdff6 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100561.260904:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818600, rc 0) 00000100:00100000:0.0:1790100561.260971:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14378:x1877056126276736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100561.260980:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790100561.261588:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126276736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100561.261636:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100561.261648:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100561.261739:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126276864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100561.261897:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100561.261946:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf4da000 going to sleep for 11 seconds 00000100:00100000:0.0:1790100561.263036:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126276864 00000100:00100000:0.0:1790100561.263053:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126276864 00000100:00100000:0.0:1790100561.263145:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790100561.263158:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14378:x1877056126276864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100561.263803:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14378:x1877056126276864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 648us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100561.263813:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790100561.263934:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126276864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100561.264012:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126276992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100561.264110:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100561.264152:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf4da000 going to sleep for 11 seconds 00000100:00100000:0.0:1790100561.265180:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126276992 00000100:00100000:0.0:1790100561.265193:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126276992 00000100:00100000:0.0:1790100561.265245:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790100561.265256:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14378:x1877056126276992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100561.265493:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:14378:x1877056126276992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100561.265507:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790100561.265545:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126276992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790100561.270042:0:14863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790100561.270236:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790100561.270280:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100561.270298:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100561.270324:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100562.277878:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790100562.730759:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790100563.305021:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100564.336428:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100565.358111:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100565.733884:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100565.733893:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790100565.733896:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100565.733899:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790100565.733938:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126277120:0@lo:400:kworker.0 00000100:00100000:3.0:1790100565.734046:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100565.734107:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100565.734113:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126277248:0@lo:400:kworker.0 00000100:00100000:3.0:1790100565.734144:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100565.734197:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126277120 00000100:00100000:3.0:1790100565.734206:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126277120 00000100:00100000:3.0:1790100565.734253:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790100565.734277:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:3313:x1877056126277120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100565.734324:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:3313:x1877056126277120:12345-0@lo:400:kworker.0 Request processed in 50us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100565.734331:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790100565.734360:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126277248 00000100:00100000:3.0:1790100565.734362:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126277248 00000100:00100000:3.0:1790100565.734380:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100565.734384:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126277248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100565.734405:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126277248:12345-0@lo:400:kworker.0 Request processed in 22us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100565.734409:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790100565.734442:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d67bf975180 x1877056126277248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100565.734454:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126277248:0@lo:400:kworker.0 00000100:00100000:3.0:1790100565.734460:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126277120:0@lo:400:kworker.0 00000020:01000004:2.0:1790100565.763969:0:15062:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790100565.763973:0:15062:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790100565.764110:0:15062:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d67a5ba5800 00000020:01000004:2.0:1790100565.764130:0:15062:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790100565.764143:0:15062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790100565.764157:0:15062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d67bf9b19c0) 00000020:00000080:2.0:1790100565.764199:0:15062:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790100565.787153:0:15062:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790100565.787845:0:15062:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790100565.788934:0:15062:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790100565.789358:0:15062:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790100565.789590:0:15062:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790100565.791360:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 675: rc = 0 00100000:10000000:2.0:1790100565.791464:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 675: rc = 0 00100000:10000000:2.0:1790100565.791565:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 675: rc = 0 00100000:10000000:2.0:1790100565.792383:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 460: rc = 0 00100000:10000000:3.0:1790100565.792959:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 460: rc = 0 00100000:10000000:3.0:1790100565.793417:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 460: rc = 0 00100000:10000000:3.0:1790100565.793710:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 460: rc = 0 00100000:10000000:3.0:1790100565.794057:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 460: rc = 0 00100000:10000000:3.0:1790100565.794458:0:15062:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 460: rc = 0 00000020:00000080:3.0:1790100565.795377:0:15062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790100565.795391:0:15062:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790100565.795402:0:15062:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x31a8f3fdeeefe00b 00000020:01000004:3.0:1790100565.795419:0:15062:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790100565.795441:0:15062:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790100565.795445:0:15062:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790100565.795452:0:15062:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790100565.795456:0:15062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790100565.795468:0:15062:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d67af0499c0) 00000020:00000080:3.0:1790100565.795479:0:15062:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1790100565.797241:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790100565.797524:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790100565.797531:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790100565.799117:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790100565.799129:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790100565.807965:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790100565.807980:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790100565.810757:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790100565.810955:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790100565.810963:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790100565.812052:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790100565.812061:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790100565.835440:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100565.835924:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790100565.835931:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790100565.837533:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790100565.837547:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790100565.838490:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790100565.838502:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790100565.840816:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100565.841038:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790100565.841047:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790100565.842247:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790100565.842321:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790100565.889111:0:15062:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790100565.889460:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790100565.889468:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790100565.891243:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790100565.891327:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790100565.892044:0:15062:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790100565.892074:0:15062:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790100565.892082:0:15062:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1790100565.907359:0:15062:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790100565.907403:0:15062:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.118@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1790100565.907407:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790100565.907409:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790100565.907411:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100565.907412:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100565.907413:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100565.907414:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100565.907416:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790100565.907417:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100565.907418:0:15062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790100565.907423:0:15062:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1790100565.907425:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790100565.907426:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790100565.907427:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100565.907428:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100565.907429:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100565.907430:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100565.907431:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790100565.907432:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100565.907436:0:15062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790100565.907475:0:15062:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790100565.907497:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790100565.907565:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100565.908584:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf4da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100565.908864:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126277376 00000100:00100000:2.0:1790100565.908874:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126277376 00000100:00100000:3.0:1790100565.909090:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790100565.909100:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:15062:x1877056126277376:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790100565.909153:0:14375:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790100565.909156:0:14375:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1790100565.909160:0:14375:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790100565.919648:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:15062:x1877056126277376:12345-0@lo:253:mount.lustre.0 Request processed in 10538us (12071us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100565.919663:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790100565.923820:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277376:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790100565.923846:0:15062:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790100565.923849:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790100565.923851:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790100565.923853:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790100565.923854:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790100565.923855:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790100565.923856:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790100565.923857:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790100565.923859:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790100565.923861:0:15062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790100565.923893:0:15062:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d67a5ba5800 from lustre-OST0000 10000000:01000000:1.0:1790100565.923927:0:15062:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790100565.923930:0:15062:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790100565.923938:0:15062:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d6784edcd40 local copy 00010000:00010000:1.0:1790100565.923963:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100565.924484:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100565.924567:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100565.924705:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67932149c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100565.924812:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126277504 00000100:00100000:3.0:1790100565.924821:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126277504 00000100:00100000:3.0:1790100565.924881:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790100565.924892:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:15062:x1877056126277504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100565.925099:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:15062:x1877056126277504:12345-0@lo:501:mount.lustre.0 Request processed in 209us (532us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790100565.925108:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790100565.925414:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277504:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790100565.925431:0:15062:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790100565.925570:0:15062:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790100565.925577:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.925587:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100565.925777:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d67a5ba5800 10000000:01000000:1.0:1790100565.925784:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790100565.925789:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d6784edcd40 10000000:01000000:1.0:1790100565.925791:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790100565.925795:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d6784edcd40 from 1 10000000:01000000:1.0:1790100565.925799:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790100565.925833:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12400/0x31a8f3fdeeefe019 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.925842:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12400/0x31a8f3fdeeefe019 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.925852:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12400/0x31a8f3fdeeefe019 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100565.925868:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790100565.925902:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100565.925936:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67932149c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100565.926197:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126277632 00000100:00100000:3.0:1790100565.926205:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126277632 00000100:00100000:3.0:1790100565.926269:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790100565.926278:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+12:15062:x1877056126277632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100565.926290:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100565.926309:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67900afe00/0x31a8f3fdeeefe020 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe019 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.926339:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900afe00/0x31a8f3fdeeefe020 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe019 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.926353:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67900afe00/0x31a8f3fdeeefe020 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe019 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100565.926364:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900afe00, rc 0) 00000100:00100000:3.0:1790100565.926415:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+13:15062:x1877056126277632:12345-0@lo:101:mount.lustre.0 Request processed in 139us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100565.926421:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790100565.926521:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100565.926536:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12400/0x31a8f3fdeeefe019 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe020 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100565.926557:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12400/0x31a8f3fdeeefe019 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe020 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100565.926580:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790100565.926598:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12400/0x31a8f3fdeeefe019 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe020 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100565.926606:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12400/0x31a8f3fdeeefe019 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe020 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100565.926638:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790100565.926644:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790100565.926651:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790100565.926654:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790100565.926675:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6785143200/0x31a8f3fdeeefe027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100565.926683:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d6785143200/0x31a8f3fdeeefe027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100565.926691:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d6785143200/0x31a8f3fdeeefe027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100565.926707:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790100565.926756:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100565.926779:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100565.927146:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126277760 00000100:00100000:1.0:1790100565.927152:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126277760 00000100:00100000:1.0:1790100565.927197:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790100565.927205:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+13:15062:x1877056126277760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100565.927213:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100565.927224:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67b5e12a00/0x31a8f3fdeeefe02e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe027 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.927239:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67b5e12a00/0x31a8f3fdeeefe02e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe027 expref: 14 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.927402:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67b5e12a00/0x31a8f3fdeeefe02e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe027 expref: 14 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.927409:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12a00, rc 0) 00000100:00100000:1.0:1790100565.927456:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126277760:12345-0@lo:101:mount.lustre.0 Request processed in 253us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100565.927463:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790100565.927543:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100565.927555:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d6785143200/0x31a8f3fdeeefe027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe02e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100565.927571:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d6785143200/0x31a8f3fdeeefe027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe02e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100565.928659:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790100565.930879:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100565.931546:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790100565.931602:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790100565.931975:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790100565.932046:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790100565.932088:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790100565.932120:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790100565.932221:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790100565.932230:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790100565.932451:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100565.932535:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100565.932592:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67838ab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100565.932709:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126277888 00000100:00100000:2.0:1790100565.932719:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126277888 00000100:00100000:2.0:1790100565.933117:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790100565.933129:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126277888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100565.933588:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126277888:12345-0@lo:501:mount.lustre.0 Request processed in 459us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100565.933598:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790100565.934830:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126277888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100565.934916:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100565.935073:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100565.935152:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67838ab6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100565.935323:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126278016 00000100:00100000:1.0:1790100565.935331:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126278016 00000100:00100000:1.0:1790100565.935408:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790100565.935418:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126278016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100565.935856:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126278016:12345-0@lo:503:mount.lustre.0 Request processed in 438us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100565.935865:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790100565.935954:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790100565.936652:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100565.936724:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100565.936773:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100565.937371:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67838ab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100565.937535:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126278144 00000100:00100000:2.0:1790100565.937546:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126278144 00000100:00100000:2.0:1790100565.937597:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790100565.937627:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126278144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100565.939548:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126278144:12345-0@lo:502:mount.lustre.0 Request processed in 1933us (2766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100565.939564:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790100565.939709:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790100565.940581:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790100565.940675:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790100565.940712:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790100565.940838:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790100565.940879:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790100565.940917:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790100565.941078:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790100565.941112:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790100565.941143:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1790100565.941342:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1790100565.941384:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1790100565.941428:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1790100565.941478:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100565.941549:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100565.941606:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67838ab6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100565.941876:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126278272 00000100:00100000:1.0:1790100565.941885:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126278272 00000100:00100000:1.0:1790100565.942054:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790100565.942066:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126278272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100565.942319:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126278272:12345-0@lo:502:mount.lustre.0 Request processed in 254us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100565.942326:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790100565.942411:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790100565.942483:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790100565.942501:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1790100565.950204:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790100565.950218:0:15076:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790100565.950226:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.950228:0:15076:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790100565.950235:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790100565.950823:0:15076:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d67af048000) 00000020:00000080:3.0:1790100565.950853:0:15076:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790100565.950862:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790100565.950932:0:15076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d67a5ba5800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790100565.950940:0:15076:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790100565.950947:0:15076:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x31a8f3fdeeefe03c 00010000:00010000:3.0:1790100565.960271:0:15076:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1790100565.960725:0:15076:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1790100565.962414:0:15076:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1790100565.965175:0:15076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790100565.965191:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100565.965198:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.965201:0:15076:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790100565.965204:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790100565.965207:0:15076:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1790100565.965208:0:15076:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790100565.965210:0:15076:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790100565.965211:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790100565.965214:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.965215:0:15076:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790100565.965218:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100565.965220:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.965221:0:15076:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790100565.965224:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790100565.965225:0:15076:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790100565.965227:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100565.965229:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.965231:0:15076:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790100565.965243:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100565.965245:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.965247:0:15076:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790100565.965250:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790100565.965441:0:15076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100565.965446:0:15076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.965447:0:15076:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790100565.965450:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1790100565.965729:0:15062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790100565.965775:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790100565.965795:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d6785143200/0x31a8f3fdeeefe027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe02e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.965811:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d6785143200/0x31a8f3fdeeefe027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe02e expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100565.965820:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67a5ba5800 from 1 10000000:01000000:0.0:1790100565.965823:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100565.965871:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.965879:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.965891:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100565.965918:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790100565.965994:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100565.966052:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67bf4da0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100565.966213:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126278400 00000100:00100000:1.0:1790100565.966220:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126278400 00000100:00100000:1.0:1790100565.966278:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790100565.966287:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+14:15062:x1877056126278400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100565.966300:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100565.966319:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe043 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.966345:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe043 expref: 15 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.966357:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe043 expref: 15 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.966366:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13800, rc 0) 00000100:00100000:1.0:1790100565.966408:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126278400:12345-0@lo:101:mount.lustre.0 Request processed in 122us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100565.966414:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790100565.966458:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100565.966472:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.966481:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100565.967080:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790100565.967527:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100565.967856:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790100565.967902:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790100565.967966:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790100565.967974:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790100565.968057:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100565.968113:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100565.968167:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126278528 00000100:00100000:1.0:1790100565.968181:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126278528 00000100:00100000:1.0:1790100565.968218:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790100565.968228:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126278528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100565.968430:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126278528:12345-0@lo:501:mount.lustre.0 Request processed in 203us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100565.968437:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790100565.968474:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100565.968499:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100565.968528:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100565.968565:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100565.968585:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126278656 00000100:00100000:1.0:1790100565.968589:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126278656 00000100:00100000:1.0:1790100565.968635:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790100565.968643:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126278656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790100565.968771:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126278656:12345-0@lo:503:mount.lustre.0 Request processed in 129us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100565.968778:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790100565.968809:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100565.968822:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790100565.979837:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790100565.979956:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100565.980070:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100565.980117:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100565.980538:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126278784 00000100:00100000:0.0:1790100565.980549:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126278784 00000100:00100000:0.0:1790100565.980593:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790100565.980603:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126278784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100565.980882:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126278784:12345-0@lo:502:mount.lustre.0 Request processed in 280us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100565.980891:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790100565.981092:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790100565.981431:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790100565.981486:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790100565.981550:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790100565.981585:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790100565.981643:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790100565.981693:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790100565.981729:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790100565.981779:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790100565.981814:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100565.981864:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100565.981893:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b25ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100565.982842:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126278912 00000100:00100000:0.0:1790100565.982854:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126278912 00000100:00100000:0.0:1790100565.982901:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790100565.982910:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126278912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100565.983131:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126278912:12345-0@lo:502:mount.lustre.0 Request processed in 221us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100565.983138:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790100565.983751:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126278912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790100565.983900:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790100565.983915:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1790100565.989945:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100565.989959:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.989961:0:15080:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790100565.989969:0:15080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67a5ba5800 00000020:00000080:3.0:1790100565.989971:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100565.989978:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100565.989980:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.989981:0:15080:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790100565.989992:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100565.989995:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.989996:0:15080:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790100565.989999:0:15080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67a5ba5800 00000020:00000080:3.0:1790100565.990002:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100565.990070:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100565.990074:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.990075:0:15080:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790100565.990078:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790100565.990081:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.990082:0:15080:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790100565.990086:0:15080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d67a5ba5800 00000020:00000080:3.0:1790100565.990088:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790100565.990124:0:15080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790100565.990128:0:15080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790100565.990129:0:15080:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790100565.990132:0:15080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1790100565.993871:0:15062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1790100565.993912:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790100565.993933:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.993960:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100565.994015:0:15062:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790100565.994026:0:15062:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d67a5ba5800 10000000:01000000:1.0:1790100565.994029:0:15062:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d67a5ba5800 10000000:01000000:1.0:1790100565.994034:0:15062:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100565.994040:0:15062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67a5ba5800 from 1 10000000:01000000:1.0:1790100565.994043:0:15062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790100565.994090:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12000/0x31a8f3fdeeefe051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.994099:0:15062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12000/0x31a8f3fdeeefe051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.994111:0:15062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12000/0x31a8f3fdeeefe051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100565.994138:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790100565.995411:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100565.995477:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043000 going to sleep for 11 seconds 00000100:00100000:0.0:1790100565.995630:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126279040 00000100:00100000:0.0:1790100565.995640:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126279040 00000100:00100000:0.0:1790100565.995690:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790100565.995702:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126279040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100565.995721:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100565.998537:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad818000/0x31a8f3fdeeefe058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe051 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.998586:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad818000/0x31a8f3fdeeefe058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe051 expref: 16 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.998600:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad818000/0x31a8f3fdeeefe058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe051 expref: 16 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100565.998638:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818000, rc 0) 00000100:00100000:0.0:1790100565.998725:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279040:12345-0@lo:101:mount.lustre.0 Request processed in 3022us (3316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100565.998748:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790100565.999830:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100565.999855:0:15062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12000/0x31a8f3fdeeefe051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe058 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100565.999866:0:15062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12000/0x31a8f3fdeeefe051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe058 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100566.000672:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1790100566.001070:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100566.001379:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1790100566.001433:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1790100566.001467:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1790100566.001528:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1790100566.001568:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1790100566.001648:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1790100566.001695:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1790100566.001753:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1790100566.001811:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1790100566.001857:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1790100566.001897:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1790100566.001952:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1790100566.001986:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1790100566.018158:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1790100566.018346:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1790100566.018404:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1790100566.018454:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1790100566.018553:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1790100566.018597:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1790100566.018656:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1790100566.018719:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1790100566.019888:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1790100566.019946:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1790100566.020043:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1790100566.020081:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1790100566.020115:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1790100566.020166:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1790100566.020202:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1790100566.020298:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1790100566.020314:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1790100566.020417:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100566.020478:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100566.020527:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b043000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100566.020588:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126279168 00000100:00100000:2.0:1790100566.020596:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126279168 00000100:00100000:2.0:1790100566.020654:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790100566.020661:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100566.020859:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279168:12345-0@lo:501:mount.lustre.0 Request processed in 198us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100566.020865:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790100566.021151:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100566.021305:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100566.021351:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100566.021421:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b25ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100566.021535:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126279296 00000100:00100000:2.0:1790100566.021541:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126279296 00000100:00100000:2.0:1790100566.021731:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790100566.021739:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790100566.021897:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279296:12345-0@lo:503:mount.lustre.0 Request processed in 159us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100566.021904:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790100566.021966:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279296:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790100566.022867:0:15062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100566.022933:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100566.022977:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100566.023006:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126279424 00000100:00100000:3.0:1790100566.023013:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126279424 00000100:00100000:3.0:1790100566.023060:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790100566.023068:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100566.023667:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279424:12345-0@lo:502:mount.lustre.0 Request processed in 482us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100566.023677:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790100566.023726:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b25ea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100566.023745:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790100566.023999:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790100566.024063:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790100566.024114:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790100566.024430:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790100566.024475:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790100566.024531:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790100566.024808:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790100566.024856:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790100566.024915:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790100566.024954:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790100566.024988:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790100566.025055:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790100566.025092:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790100566.025121:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790100566.025161:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790100566.025429:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790100566.025461:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790100566.025510:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790100566.025550:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790100566.025776:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790100566.025853:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790100566.025911:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790100566.025947:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790100566.025997:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790100566.026065:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790100566.026120:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790100566.026460:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790100566.026506:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790100566.026542:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790100566.026765:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790100566.026817:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790100566.026850:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790100566.026883:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790100566.026930:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790100566.026964:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790100566.027045:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790100566.027085:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790100566.027121:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790100566.027373:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790100566.027416:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790100566.027485:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100566.027762:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100566.027807:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad458540 going to sleep for 11 seconds 00000100:00100000:1.0:1790100566.027909:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126279552 00000100:00100000:1.0:1790100566.027918:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126279552 00000100:00100000:1.0:1790100566.027975:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790100566.027985:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100566.028255:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279552:12345-0@lo:502:mount.lustre.0 Request processed in 271us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100566.028263:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790100566.031221:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790100566.031382:0:15062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790100566.031401:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1790100566.039328:0:15085:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790100566.039346:0:15085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d6787a28000) 00000020:00000080:0.0:1790100566.039368:0:15085:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1790100566.039452:0:15085:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d67a5ba5800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790100566.039457:0:15085:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d67a5ba5800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790100566.039459:0:15085:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67a5ba5800 3 00010000:00080000:0.0:1790100566.039489:0:15085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d67bbb83800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.118@tcp at head 00010000:00010000:0.0:1790100566.041205:0:15085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1790100566.041424:0:15085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790100566.041463:0:15085:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790100566.041477:0:15085:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x31a8f3fdeeefe066 00000100:00080000:0.0:1790100566.041488:0:15085:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790100566.041498:0:15085:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d67bbb83800 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100566.041541:0:15085:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67b5a80a80 x1877056126279680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790100566.041572:0:15085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790100566.041779:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100566.041801:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790100566.041804:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100566.041807:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1790100566.042055:0:15085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1790100566.042132:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1877056126279680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790100566.042201:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1790100566.042269:0:15062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790100566.042294:0:15062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790100566.042306:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12000/0x31a8f3fdeeefe051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe058 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.042317:0:15062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12000/0x31a8f3fdeeefe051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe058 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790100566.042358:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790100566.042360:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100566.042361:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100566.042366:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100566.042368:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100566.042369:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100566.042371:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100566.042372:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100566.042374:0:15062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790100566.042378:0:15062:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790100566.042381:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100566.042382:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790100566.042383:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100566.042384:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100566.042385:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100566.042386:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100566.042387:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100566.042388:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:3.0:1790100566.042389:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126279680 00000020:01000004:2.0:1790100566.042390:0:15062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1790100566.042399:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126279680 10000000:01000000:2.0:1790100566.042415:0:15062:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790100566.042428:0:15062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790100566.042437:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100566.042447:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1877056126279680:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790100566.042464:0:15062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790100566.042478:0:14383:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000100:00100000:2.0:1790100566.042490:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126279808 00000100:00100000:2.0:1790100566.042494:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126279808 00000020:00000080:3.0:1790100566.042514:0:14383:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x31a8f3fdeeefe06d 00000004:00100000:3.0:1790100566.042532:0:14383:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790100566.042570:0:14383:0:(import.c:65:import_set_state_nolock()) ffff8d6799d96800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100566.042978:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790100566.042990:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15062:x1877056126279808:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790100566.043011:0:14376:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790100566.043035:0:14376:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790100566.043141:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877056126279680:12345-0@lo:38:llog_process_th.0 Request processed in 692us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100566.043356:0:15062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad458540 going to sleep for 11 seconds 00000100:00100000:3.0:1790100566.043372:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790100566.043448:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d67b5a80a80 x1877056126279680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100566.043460:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100566.043468:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1790100566.043475:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790100566.043481:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790100566.043484:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67bbb83800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790100566.043490:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1877056126279680:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1790100566.114358:0:14376:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790100566.114414:0:14376:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790100566.115872:0:14397:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790100566.115880:0:14397:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790100566.115976:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100566.115998:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdfda expref: 16 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100566.116009:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100566.116065:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefdfda expref: 16 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100566.116081:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfda expref: 16 pid: 14375 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100566.116097:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1877056126279936:0@lo:104: 00000100:00100000:3.0:1790100566.116169:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100566.116249:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67b25ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100566.116894:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126279936 00000100:00100000:2.0:1790100566.116973:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126279936 00000100:00100000:2.0:1790100566.117068:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100566.117079:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:14397:x1877056126279936:12345-0@lo:104: 00010000:00010000:2.0:1790100566.117094:0:14366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.117174:0:14366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790100566.117180:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:14397:x1877056126279936:12345-0@lo:104: Request processed in 104us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100566.117188:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100566.117273:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1877056126279936:0@lo:104: 00010000:00010000:3.0:1790100566.117295:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.118511:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100566.118523:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.118534:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1790100566.118538:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.118548:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790100566.118555:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790100566.118561:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790100566.118605:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.118636:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790100566.118660:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.118667:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefdfda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdfe1 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.118701:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100566.118704:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100566.118705:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100566.118721:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100566.118747:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126280064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100566.118801:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100566.118850:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126280064 00000100:00100000:2.0:1790100566.118858:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126280064 00010000:00010000:2.0:1790100566.118882:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfda expref: 17 pid: 14375 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100566.119050:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100566.119060:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:3312:x1877056126280064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100566.119074:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100566.119079:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfda expref: 17 pid: 14375 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119090:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfda expref: 17 pid: 14375 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119104:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67ad819c00/0x31a8f3fdeeefdfe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefdfda expref: 17 pid: 14375 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119117:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119125:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790100566.119150:0:14369:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003270993s 00010000:00010000:2.0:1790100566.119155:0:14369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119161:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119167:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119173:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119178:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100566.119181:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119188:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119202:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119213:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100566.119249:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3312:x1877056126280064:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100566.119270:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790100566.119308:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126280064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100566.119328:0:14397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119342:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100566.119348:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67900af800/0x31a8f3fdeeefe074 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100566.126232:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:15062:x1877056126279808:12345-0@lo:253:mount.lustre.0 Request processed in 83235us (83758us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100566.126246:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790100566.126395:0:15062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15062:1877056126279808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790100566.126412:0:15062:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790100566.126416:0:15062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100566.126418:0:15062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790100566.126419:0:15062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100566.126420:0:15062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100566.126421:0:15062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100566.126423:0:15062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100566.126424:0:15062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100566.126426:0:15062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100566.126427:0:15062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790100566.126443:0:15062:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790100566.140177:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790100566.140403:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790100566.140574:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790100566.140776:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790100566.141361:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790100566.141602:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790100566.145164:0:15062:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1790100566.235113:0:15062:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790100566.235127:0:15062:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790100566.235344:0:15062:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790100566.235416:0:15062:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790100566.235434:0:15062:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790100566.235467:0:15062:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790100566.377078:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100567.401879:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790100567.464392:0:14378:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790100567.464405:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6682507800 from 7 10000000:01000000:0.0:1790100567.464411:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790100567.464478:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.464491:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.464524:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100567.464552:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126280192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790100567.464698:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100567.464752:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787a21900 going to sleep for 11 seconds 00000100:00100000:1.0:1790100567.464843:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126280192 00000100:00100000:1.0:1790100567.464853:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126280192 00000100:00100000:1.0:1790100567.464912:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790100567.464922:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+15:14378:x1877056126280192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100567.464949:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100567.464966:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe07b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100567.464990:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe07b expref: 16 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100567.465012:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe07b expref: 16 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100567.465021:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13600, rc 0) 00000100:00100000:1.0:1790100567.465072:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:14378:x1877056126280192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100567.465088:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790100567.465197:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126280192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100567.465211:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100567.465220:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100567.465273:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126280320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790100567.465305:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100567.465326:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787a21900 going to sleep for 11 seconds 00000100:00100000:2.0:1790100567.465443:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126280320 00000100:00100000:2.0:1790100567.465448:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126280320 00000100:00100000:2.0:1790100567.465481:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790100567.465488:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:14378:x1877056126280320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790100567.465502:0:14376:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790100567.465519:0:14376:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790100567.465522:0:14376:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1790100567.465641:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:14378:x1877056126280320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100567.465648:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790100567.466240:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126280320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790100567.466305:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790100567.466313:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100567.466332:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100568.422346:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100569.447117:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100570.473220:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790100571.369800:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100571.369808:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790100571.369829:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790100571.369832:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790100571.371682:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126280576:0@lo:400:kworker.0 00000100:00100000:3.0:1790100571.371783:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100571.371874:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100571.371883:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126280704:0@lo:400:kworker.0 00000100:00100000:3.0:1790100571.371911:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100571.371984:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126280576 00000100:00100000:3.0:1790100571.371998:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126280576 00000100:00100000:3.0:1790100571.372064:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126280704 00000100:00100000:3.0:1790100571.372068:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126280704 00000100:00100000:3.0:1790100571.372100:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100571.372111:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126280576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100571.372192:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126280576:12345-0@lo:400:kworker.0 Request processed in 82us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100571.372200:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100571.372220:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100571.372227:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126280704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100571.372256:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126280704:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100571.372263:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1790100571.372309:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790100571.372350:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf977100 x1877056126280704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100571.372372:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126280704:0@lo:400:kworker.0 00010000:00080000:3.0:1790100571.372406:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf974e00 x1877056126280576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100571.372415:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126280576:0@lo:400:kworker.0 00000100:00100000:2.0:1790100571.374458:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126280448:0@lo:400:kworker.0 00000100:00100000:2.0:1790100571.374590:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100571.377719:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126280448 00000100:00100000:0.0:1790100571.377747:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126280448 00000100:00100000:0.0:1790100571.377844:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790100571.377859:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3312:x1877056126280448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100571.378024:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3312:x1877056126280448:12345-0@lo:400:kworker.0 Request processed in 169us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100571.378032:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790100571.378112:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126280448:0@lo:400:kworker.0 00010000:00010000:2.0:1790100571.493825:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100572.518972:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790100572.973372:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790100573.542164:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790100573.982029:0:15428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790100574.565898:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100575.270527:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100560/real 1790100560] req@ffff8d67b5a82680 x1877056126276352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100575.270571:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d67b5a82680 x1877056126276352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100575.270583:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790100560/real 1790100560] req@ffff8d67b5a83480 x1877056126276480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100575.270595:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d67b5a83480 x1877056126276480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790100575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790100575.271344:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d66811e3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790100575.272125:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790100575.272132:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126276352:0@lo:8:kworker.0 00000100:00080000:3.0:1790100575.272142:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790100575.275714:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100575.275723:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790100575.275728:0:487:0:(import.c:65:import_set_state_nolock()) ffff8d66811e3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100575.275753:0:487:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:1.0:1790100575.275762:0:487:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790100575.275780:0:487:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d66811e3000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1790100575.275823:0:487:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67bf3fdc00 x1877056126280960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100575.275837:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100575.275840:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790100575.275842:0:487:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100575.275846:0:487:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:1.0:1790100575.275849:0:487:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790100575.275854:0:487:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d678a4bf000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1790100575.275878:0:487:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67bf3fd180 x1877056126281088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790100575.276684:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126281216:0@lo:400:kworker.0 00000100:00100000:1.0:1790100575.276786:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100575.276944:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100575.276952:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126280832:0@lo:400:kworker.0 00000100:00100000:1.0:1790100575.277087:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100575.277192:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126280832 00000100:00100000:1.0:1790100575.277202:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126280832 00000100:00100000:1.0:1790100575.277259:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790100575.277271:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3312:x1877056126280832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100575.277334:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3312:x1877056126280832:12345-0@lo:400:kworker.0 Request processed in 65us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100575.277342:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790100575.278188:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126280832:0@lo:400:kworker.0 00000100:00080000:3.0:1790100575.278690:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790100575.278697:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126276480:0@lo:8:kworker.0 00000100:00100000:3.0:1790100575.278740:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126281216 00000100:00100000:3.0:1790100575.278749:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126281216 00000100:00100000:3.0:1790100575.278796:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790100575.278805:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126281216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100575.278913:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126281216:12345-0@lo:400:kworker.0 Request processed in 108us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100575.278921:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790100575.278940:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf3fe680 x1877056126281216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100575.278955:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126281216:0@lo:400:kworker.0 00000100:00100000:3.0:1790100575.280326:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126281344:0@lo:400:kworker.0 00000100:00100000:3.0:1790100575.280400:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100575.280450:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126281344 00000100:00100000:1.0:1790100575.280460:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126281344 00000100:00100000:1.0:1790100575.280523:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790100575.280535:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126281344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100575.280636:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126281344:12345-0@lo:400:kworker.0 Request processed in 103us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100575.280643:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790100575.280650:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf3fc700 x1877056126281344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100575.280665:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126281344:0@lo:400:kworker.0 00000100:00080000:1.0:1790100575.280668:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100575.280702:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126280960:0@lo:8:kworker.0 00000100:00100000:3.0:1790100575.280735:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100575.280771:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126281088:0@lo:8:kworker.0 00000100:00100000:1.0:1790100575.280777:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126280960 00000100:00100000:1.0:1790100575.280781:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126280960 00000100:00100000:3.0:1790100575.280795:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100575.280806:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126281088 00000100:00100000:1.0:1790100575.280809:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126281088 00000100:00100000:1.0:1790100575.280914:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100575.280920:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1877056126280960:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790100575.280957:0:15063:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1790100575.281165:0:15063:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefe089 00002000:00100000:1.0:1790100575.281186:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d67861f9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1790100575.281191:0:15063:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1790100575.281195:0:15063:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790100575.281684:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790100575.281722:0:15063:0:(import.c:65:import_set_state_nolock()) ffff8d67861fc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100575.281799:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1877056126280960:12345-0@lo:8:kworker.0 Request processed in 877us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100575.281808:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100575.282162:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100575.282173:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1877056126281088:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790100575.282194:0:15063:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790100575.282235:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1877056126281088:12345-0@lo:8:kworker.0 Request processed in 62us (1438us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790100575.282241:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790100575.283660:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf3fdc00 x1877056126280960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100575.283677:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790100575.283688:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790100575.283700:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790100575.283707:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790100575.283710:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d66811e3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790100575.283735:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790100575.283742:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126280960:0@lo:8:kworker.0 00000100:00080000:3.0:1790100575.283758:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790100575.283762:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790100575.283765:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126281088:0@lo:8:kworker.0 00000004:00080000:3.0:1790100575.283857:0:14404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1790100575.283893:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14404:1877056126281600:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790100575.283953:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100575.283984:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67889af9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100575.284001:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126281472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100575.284028:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100575.284078:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126281600 00000100:00100000:3.0:1790100575.284085:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126281600 00000100:00100000:3.0:1790100575.284145:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100575.284156:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14404:x1877056126281600:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790100575.284335:0:14403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790100575.286402:0:14403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471855786427ns, next at 0ns, rc = 0 00000100:00080000:3.0:1790100575.288367:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790100575.290756:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126281472 00000100:00100000:1.0:1790100575.290778:0:15067:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126281472 00000100:00100000:1.0:1790100575.290853:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100575.290879:0:15067:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877056126281472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100575.290931:0:15067:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100575.291196:0:15067:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877056126281472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 332us (7166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100575.291205:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790100575.294139:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf975500 x1877056126281472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100575.294182:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126281472:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1790100575.301529:0:15064:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790100575.301545:0:15064:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1790100575.301552:0:15064:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1790100575.321290:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.321307:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321331:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.321338:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.321347:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321385:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321399:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321409:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321432:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100575.321450:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100575.321457:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321467:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100575.321473:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321484:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321508:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321516:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe090 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.321543:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.321545:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.321547:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.323732:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.323748:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.323770:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.323776:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.323783:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.323801:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.323813:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.323822:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.323847:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100575.324406:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.324417:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.324436:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.324441:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.324452:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.324478:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.324488:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe097 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.324510:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.324512:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.324514:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.326490:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.326507:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.326539:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.326545:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.326553:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.326571:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.326584:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.326592:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.326633:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100575.327494:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100575.327506:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.327517:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100575.327523:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.327534:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.327562:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.327570:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe09e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.327592:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100575.327594:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100575.327595:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.330339:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.330359:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330378:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.330384:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.330391:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330410:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330442:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330450:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330487:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100575.330505:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100575.330511:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330520:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100575.330525:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330536:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330560:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330568:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.330592:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.330600:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.330602:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.332716:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.332740:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332763:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.332769:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.332776:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332795:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332809:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332818:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332844:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100575.332871:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100575.332879:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332888:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100575.332893:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332918:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332941:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332950:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.332970:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.332972:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.332974:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.335078:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.335092:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.335111:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.335117:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.335124:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.335140:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.335153:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.335169:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.335189:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100575.335206:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100575.335212:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.337310:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100575.337327:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.337346:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.337372:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.337380:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.337406:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.337408:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.337411:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.338745:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.338768:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.339008:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.339015:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.339023:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.339039:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.339051:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.339059:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.339084:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100575.339347:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.339356:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.339367:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.339372:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.339382:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.339409:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.339418:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe0ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.339440:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.339443:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.339445:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.340006:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.340014:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.340024:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.340029:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.340034:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.340045:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.340059:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.340068:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.340091:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100575.340344:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.340351:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.340361:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.340365:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.340375:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.340390:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.340396:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe0c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.340423:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.340425:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.340427:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.340924:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.340931:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.340942:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.340945:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.340950:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.340962:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.340970:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.340978:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.341007:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100575.341329:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.341335:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.341344:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.341348:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.341357:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.341371:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.341379:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe0c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.341393:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.341395:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.341397:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.344720:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.344741:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.344765:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.344770:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.344778:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.344797:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.344810:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.344820:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.344846:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100575.345394:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.345404:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.345426:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aea00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.345431:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.345442:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.345536:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.345546:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe0cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.345573:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.345578:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.345580:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.346426:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.346437:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.346450:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=471s v=(0 0) 00000004:00080000:0.0:1790100575.346576:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1790100575.346602:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.346723:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.346741:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.346752:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.346760:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.346978:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790100575.347656:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.347666:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.347682:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.347687:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.347693:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.347706:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.347718:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.347732:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.348030:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.348041:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.348050:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.348055:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.348065:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.348094:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.348103:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe0d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.348124:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.348127:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.348129:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.348747:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790100575.349302:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.349313:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.349326:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.349331:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.349342:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.349361:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.349369:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe0dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.349407:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.349409:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.349411:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.349936:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.349946:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.349961:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.349966:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.349974:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.349989:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.350000:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.350008:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.350293:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790100575.350884:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.350892:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.350912:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.350915:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.350921:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.350933:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.350942:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.350949:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.352094:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100575.352114:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.352146:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100575.352152:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.352164:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.352196:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100575.352206:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe0e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100575.352321:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100575.352329:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100575.352337:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100575.352341:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100575.352349:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100575.352367:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100575.352377:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.352378:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790100575.352378:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100575.352381:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.352388:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe0eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.352534:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.353562:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.353573:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.353594:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.353601:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.353714:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.353745:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.353763:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.353771:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.353828:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790100575.355376:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.355390:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.355409:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.355414:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.355422:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.355436:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.355447:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.355528:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355647:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100575.355658:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355668:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aee00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.355675:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355686:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355708:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355716:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe0f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355734:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.355738:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355744:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.355755:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355763:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355774:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.355782:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.355784:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.355786:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.355879:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790100575.355885:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe0f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.356318:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.356759:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.356767:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.356781:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.356786:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.356791:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.356804:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.356814:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.356823:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.356891:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790100575.357296:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.357302:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.357312:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.357315:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.357319:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.357329:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.357337:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.357346:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357439:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100575.357447:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357465:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.357470:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357479:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357496:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357504:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe100 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357533:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.357536:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357542:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.357545:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357553:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357563:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.357571:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.357572:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.357574:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.357782:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790100575.357787:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe107 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100575.358419:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.358427:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.358446:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.358450:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.358525:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.358540:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.358550:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.358557:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.358593:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.358599:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.358608:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900afc00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.358639:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.358662:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.358678:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.358689:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.358691:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.358693:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.358781:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790100575.358786:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003689a78b/0x31a8f3fdeeefe10e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100575.359322:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.359330:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.359341:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.359344:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.359349:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.359371:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.359379:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.359386:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.359418:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.359424:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.359431:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.359435:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.359442:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.359529:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.359541:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.359543:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.359545:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.359674:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790100575.359681:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d93417b/0x31a8f3fdeeefe115 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100575.361060:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.361072:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.361087:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.361092:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.361097:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.361186:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.361211:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.361294:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.361372:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.361380:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.361390:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.361396:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.361408:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.361428:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.361438:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.361440:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.361441:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.361580:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790100575.361586:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000964b92e1/0x31a8f3fdeeefe11c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100575.362665:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.362679:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.362697:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.362703:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.362710:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.362726:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.362737:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.362756:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.362830:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.362839:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.362848:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aea00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.362852:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.362870:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.362905:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.362914:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.362917:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.362918:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.363004:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790100575.363011:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd48d7f3/0x31a8f3fdeeefe123 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100575.364008:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.364019:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.364032:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.364037:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.364043:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.364059:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.364069:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.364076:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.364337:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.364345:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.364355:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.364360:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.364370:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.364387:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.364397:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.364398:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.364399:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100575.364539:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790100575.364546:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faa3a157/0x31a8f3fdeeefe12a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.364969:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100575.366537:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.366555:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.366576:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.366581:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.366589:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.366605:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.366647:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.366655:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.366676:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790100575.367222:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.367229:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367246:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.367249:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.367253:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367265:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367273:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367281:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367302:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790100575.367737:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.367743:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367752:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.367755:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.367759:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367769:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367787:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367793:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.367801:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1790100575.368222:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.368228:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368237:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.368240:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.368244:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368253:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368260:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368267:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368283:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1790100575.368689:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100575.368694:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368702:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1790100575.368705:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100575.368708:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368716:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368723:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368730:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100575.368737:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:3.0:1790100575.368922:0:15064:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1790100575.369069:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14404:x1877056126281600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 84909us (85110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100575.369080:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100575.369155:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14404:1877056126281600:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790100575.369186:0:14404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1790100575.369251:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14404:1877056126281728:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790100575.369293:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100575.369349:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67889af9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100575.369370:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126281728 00000100:00100000:3.0:1790100575.369378:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126281728 00000100:00100000:3.0:1790100575.369423:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100575.369432:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14404:x1877056126281728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790100575.369484:0:15063:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1790100575.370480:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790100575.370497:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370522:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.370527:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370540:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370565:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370570:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe131 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370598:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790100575.370601:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370605:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.370607:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370630:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370639:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370652:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe138 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370667:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790100575.370672:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370678:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.370681:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370689:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370699:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370705:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe13f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370716:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790100575.370718:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370722:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aee00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.370729:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370735:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370740:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370744:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe146 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370753:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790100575.370756:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370760:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100575.370762:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370765:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370770:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370774:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe14d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100575.370786:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.370788:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100575.370789:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100575.370859:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100575.389301:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14404:x1877056126281728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19854us (19992us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790100575.389325:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100575.389440:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14404:1877056126281728:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790100575.389461:0:14404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1790100575.590669:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100576.625684:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790100576.634102:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1790100576.634124:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1790100577.639531:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100578.662305:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100579.688747:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790100580.581809:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100580.581819:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790100580.581825:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100580.581835:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:1.0:1790100580.581844:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790100580.581859:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d678a4bf000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1790100580.581886:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67bf3fe300 x1877056126282112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790100580.581974:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126281984:0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.582073:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100580.582149:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100580.582156:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126281856:0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.582187:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100580.582221:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126282240:0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.582247:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100580.582265:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100580.582270:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126282368:0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.582294:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100580.582344:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126281984 00000100:00100000:1.0:1790100580.582354:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126281984 00000100:00100000:1.0:1790100580.582486:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100580.582498:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126281984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.582562:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126281984:12345-0@lo:400:kworker.0 Request processed in 67us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100580.582569:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790100580.582594:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126281856 00000100:00100000:1.0:1790100580.582597:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126281856 00000100:00100000:1.0:1790100580.582648:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790100580.582656:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3312:x1877056126281856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.582687:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3312:x1877056126281856:12345-0@lo:400:kworker.0 Request processed in 33us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100580.582693:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790100580.582722:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126282240 00000100:00100000:2.0:1790100580.583984:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126282112:0@lo:8:kworker.0 00000100:00100000:2.0:1790100580.584071:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100580.584146:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126282112 00000100:00100000:2.0:1790100580.584155:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126282112 00000100:00100000:2.0:1790100580.584195:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100580.584202:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1877056126282112:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790100580.584230:0:15063:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790100580.584480:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126282240 00000100:00100000:1.0:1790100580.584528:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126282368 00000100:00100000:1.0:1790100580.584532:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126282368 00000100:00100000:1.0:1790100580.584559:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100580.584567:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126282240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.584658:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126282240:12345-0@lo:400:kworker.0 Request processed in 91us (2409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100580.584665:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100580.584684:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790100580.584691:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126282368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.584722:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126282368:12345-0@lo:400:kworker.0 Request processed in 32us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100580.584728:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1790100580.584754:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790100580.584760:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790100580.584836:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf3ff800 x1877056126282368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100580.584855:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126282368:0@lo:400:kworker.0 00010000:00080000:1.0:1790100580.584870:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf3fd880 x1877056126282240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100580.584879:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126282240:0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.584926:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126281856:0@lo:400:kworker.0 00000100:00100000:1.0:1790100580.584940:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790100580.584953:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126281984:0@lo:400:kworker.0 00000100:00100000:0.0:1790100580.586726:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126282496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100580.586831:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100580.587291:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126282496 00000100:00100000:1.0:1790100580.587322:0:15067:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126282496 00000100:00100000:1.0:1790100580.587391:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790100580.587419:0:15067:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126282496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790100580.587465:0:15067:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100580.600249:0:15067:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126282496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12836us (13406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100580.600268:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100580.602993:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126282496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100580.624584:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1877056126282112:12345-0@lo:8:kworker.0 Request processed in 40365us (40497us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790100580.624605:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790100580.624709:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790100580.624717:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790100580.624721:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126282112:0@lo:8:kworker.0 00010000:00010000:0.0:1790100580.711196:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100581.734146:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100582.184503:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790100582.766108:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790100583.036176:0:15780:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790100583.036183:0:15780:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790100583.036354:0:15780:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d67ad05d000 00000020:01000004:2.0:1790100583.036376:0:15780:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790100583.036394:0:15780:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790100583.036414:0:15780:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d67bf9b0000) 00000020:00000080:2.0:1790100583.036437:0:15780:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790100583.058281:0:15780:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790100583.058753:0:15780:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790100583.060405:0:15780:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790100583.061144:0:15780:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790100583.061412:0:15780:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790100583.062107:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:2.0:1790100583.062273:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1790100583.062373:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:2.0:1790100583.063194:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 774: rc = 0 00100000:10000000:2.0:1790100583.063557:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 774: rc = 0 00100000:10000000:2.0:1790100583.064220:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 774: rc = 0 00100000:10000000:2.0:1790100583.064507:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:2.0:1790100583.065147:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:2.0:1790100583.065419:0:15780:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 774: rc = 0 00000020:00000080:2.0:1790100583.066397:0:15780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790100583.066414:0:15780:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790100583.066428:0:15780:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x31a8f3fdeeefe15b 00000020:01000004:2.0:1790100583.066440:0:15780:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790100583.066468:0:15780:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790100583.066473:0:15780:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790100583.066480:0:15780:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790100583.066508:0:15780:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790100583.066514:0:15780:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790100583.080377:0:15780:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790100583.080431:0:15780:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.118@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790100583.080436:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790100583.080438:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790100583.080440:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100583.080441:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100583.080442:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100583.080443:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100583.080451:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100583.080453:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100583.080454:0:15780:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100583.080459:0:15780:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790100583.080461:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790100583.080462:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790100583.080463:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790100583.080464:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790100583.080465:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790100583.080465:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790100583.080466:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790100583.080467:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790100583.080468:0:15780:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790100583.080505:0:15780:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790100583.080532:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126282624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790100583.081275:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100583.081454:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a9735cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100583.081539:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126282624 00000100:00100000:1.0:1790100583.081551:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126282624 00000100:00100000:1.0:1790100583.081757:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790100583.081769:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15780:x1877056126282624:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790100583.081834:0:14374:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790100583.081839:0:14374:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1790100583.081844:0:14374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790100583.092405:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15780:x1877056126282624:12345-0@lo:253:mount.lustre.0 Request processed in 10622us (11116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100583.092426:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790100583.092540:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126282624:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790100583.092558:0:15780:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790100583.092561:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790100583.092563:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790100583.092564:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790100583.092564:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790100583.092565:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790100583.092566:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790100583.092568:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790100583.092569:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790100583.092570:0:15780:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790100583.092593:0:15780:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d67ad05d000 from lustre-OST0001 10000000:01000000:0.0:1790100583.092662:0:15780:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790100583.092666:0:15780:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790100583.092676:0:15780:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d6784edcd40 local copy 00010000:00010000:0.0:1790100583.092693:0:15780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100583.093293:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126282752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100583.093352:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100583.095648:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787d549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100583.095775:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126282752 00000100:00100000:2.0:1790100583.095819:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126282752 00000100:00100000:2.0:1790100583.096026:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790100583.096049:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15780:x1877056126282752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100583.096780:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15780:x1877056126282752:12345-0@lo:501:mount.lustre.0 Request processed in 739us (3423us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790100583.096791:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790100583.096920:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126282752:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790100583.097079:0:15780:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790100583.097292:0:15780:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790100583.097303:0:15780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100583.097316:0:15780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67b5e13000/0x31a8f3fdeeefdf01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefdf08 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100583.097361:0:15780:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d67ad05d000 10000000:01000000:1.0:1790100583.097367:0:15780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790100583.097374:0:15780:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790100583.097377:0:15780:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790100583.097382:0:15780:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790100583.097386:0:15780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790100583.097435:0:15780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefe162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100583.097444:0:15780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefe162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100583.097457:0:15780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefe162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100583.097482:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126282880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790100583.097531:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100583.097581:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787d549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100583.097598:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126282880 00000100:00100000:3.0:1790100583.097606:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126282880 00000100:00100000:3.0:1790100583.097675:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790100583.097686:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:15780:x1877056126282880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100583.097702:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100583.097723:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67900af000/0x31a8f3fdeeefe169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe162 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.097765:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900af000/0x31a8f3fdeeefe169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe162 expref: 17 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.097779:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67900af000/0x31a8f3fdeeefe169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe162 expref: 17 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.097801:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af000, rc 0) 00000100:00100000:3.0:1790100583.097851:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126282880:12345-0@lo:101:mount.lustre.0 Request processed in 167us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100583.098073:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126282880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790100583.098087:0:15780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefe162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe169 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100583.098097:0:15780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefe162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe169 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790100583.098874:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000100:00100000:3.0:1790100583.100867:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000040:00080000:1.0:1790100583.102497:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790100583.103464:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790100583.103558:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790100583.103598:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790100583.104921:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790100583.105377:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790100583.105399:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790100583.105467:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790100583.105472:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790100583.105597:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790100583.105742:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100583.105803:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787d54300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100583.105899:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126283008 00000100:00100000:3.0:1790100583.105911:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126283008 00000100:00100000:3.0:1790100583.106080:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790100583.106093:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126283008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100583.106700:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126283008:12345-0@lo:501:mount.lustre.0 Request processed in 608us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100583.106710:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790100583.106753:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100583.106813:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100583.106883:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.108338:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100583.108370:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126283136 00000100:00100000:3.0:1790100583.108380:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126283136 00000100:00100000:3.0:1790100583.108424:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790100583.108436:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126283136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100583.108940:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126283136:12345-0@lo:503:mount.lustre.0 Request processed in 504us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100583.108961:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790100583.109363:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790100583.111317:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100583.111462:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100583.111569:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.111663:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100583.111705:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126283264 00000100:00100000:3.0:1790100583.111717:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126283264 00000100:00100000:3.0:1790100583.111788:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790100583.111799:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126283264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100583.112973:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126283264:12345-0@lo:502:mount.lustre.0 Request processed in 1160us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100583.112986:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790100583.113801:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100583.114683:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1790100583.114768:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1790100583.114806:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1790100583.114857:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1790100583.114898:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1790100583.114932:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1790100583.115598:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1790100583.115689:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1790100583.115754:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1790100583.115826:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100583.116347:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100583.116465:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787d54cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100583.116529:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126283392 00000100:00100000:2.0:1790100583.116540:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126283392 00000100:00100000:2.0:1790100583.116759:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790100583.116776:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126283392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100583.117087:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126283392:12345-0@lo:502:mount.lustre.0 Request processed in 318us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100583.117104:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790100583.117229:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100583.117348:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1790100583.117366:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1790100583.118587:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790100583.118686:0:15781:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1790100583.118696:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790100583.118699:0:15781:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790100583.118709:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790100583.118759:0:15781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d6681b80000) 00000020:00000080:0.0:1790100583.118790:0:15781:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790100583.118798:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790100583.118884:0:15781:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d67ad05d000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790100583.118895:0:15781:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790100583.118902:0:15781:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x31a8f3fdeeefe177 00010000:00010000:1.0:1790100583.131409:0:15781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1790100583.132486:0:15781:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1790100583.147487:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790100583.151934:0:15781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790100583.151962:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100583.151971:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100583.151974:0:15781:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790100583.151977:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100583.151983:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100583.151985:0:15781:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790100583.151988:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790100583.151990:0:15781:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790100583.151992:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100583.151995:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100583.151996:0:15781:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790100583.151998:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790100583.152000:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100583.152001:0:15781:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790100583.152004:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790100583.152095:0:15781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790100583.152099:0:15781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790100583.152101:0:15781:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790100583.152105:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1790100583.152550:0:15780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1790100583.152585:0:15780:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790100583.152639:0:15780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefe162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe169 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100583.152654:0:15780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67b5e12200/0x31a8f3fdeeefe162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe169 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790100583.152664:0:15780:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67ad05d000 from 1 10000000:01000000:0.0:1790100583.152667:0:15780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790100583.152718:0:15780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100583.152727:0:15780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100583.152750:0:15780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100583.152783:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790100583.153158:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.153242:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100583.153342:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126283520 00000100:00100000:2.0:1790100583.153353:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126283520 00000100:00100000:2.0:1790100583.153420:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790100583.153433:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:15780:x1877056126283520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790100583.153451:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100583.153468:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe17e expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.153498:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe17e expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.153511:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe17e expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.153522:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143e00, rc 0) 00000100:00100000:2.0:1790100583.153573:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126283520:12345-0@lo:101:mount.lustre.0 Request processed in 143us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100583.153580:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790100583.153773:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790100583.153791:0:15780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100583.153800:0:15780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790100583.155501:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790100583.159484:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790100583.159926:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790100583.159994:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790100583.160065:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790100583.160075:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790100583.160207:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100583.160308:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.160384:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126283648 00000100:00100000:0.0:1790100583.160393:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126283648 00000100:00100000:0.0:1790100583.160449:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100583.160459:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126283648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100583.165766:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126283648:12345-0@lo:501:mount.lustre.0 Request processed in 5292us (5442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100583.165789:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790100583.167125:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100583.167179:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790100583.167262:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790100583.167522:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.167581:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100583.168934:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126283776 00000100:00100000:3.0:1790100583.168958:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126283776 00000100:00100000:3.0:1790100583.169040:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790100583.169052:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6791358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126283776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100583.169542:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6791358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126283776:12345-0@lo:503:mount.lustre.0 Request processed in 489us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100583.169551:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790100583.170378:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283776:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790100583.173504:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790100583.173662:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100583.173777:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.173839:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2600 going to sleep for 11 seconds 00000100:00100000:1.0:1790100583.174379:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126283904 00000100:00100000:1.0:1790100583.174391:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126283904 00000100:00100000:1.0:1790100583.174463:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790100583.174475:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6791359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126283904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100583.174871:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6791359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126283904:12345-0@lo:502:mount.lustre.0 Request processed in 396us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100583.174880:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790100583.175175:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126283904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790100583.175516:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790100583.175577:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1790100583.175706:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1790100583.176267:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1790100583.176311:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1790100583.176380:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1790100583.176420:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1790100583.176456:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1790100583.176513:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100583.176604:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.176700:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1790100583.176714:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126284032 00000100:00100000:2.0:1790100583.176723:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126284032 00000100:00100000:2.0:1790100583.176798:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790100583.176809:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126284032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790100583.177209:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126284032:12345-0@lo:502:mount.lustre.0 Request processed in 400us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100583.177218:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790100583.177442:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790100583.177563:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1790100583.177575:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1790100583.180037:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100583.180073:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100583.180076:0:15785:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790100583.180085:0:15785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67ad05d000 00000020:00000080:2.0:1790100583.180088:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790100583.180100:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100583.180103:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100583.180104:0:15785:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790100583.180107:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100583.180110:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100583.180112:0:15785:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790100583.180115:0:15785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d67ad05d000 00000020:00000080:2.0:1790100583.180117:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790100583.180204:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100583.180209:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100583.180210:0:15785:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790100583.180213:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790100583.180215:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100583.180217:0:15785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790100583.180220:0:15785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d67ad05d000 00000020:00000080:2.0:1790100583.180223:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790100583.180268:0:15785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790100583.180272:0:15785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790100583.180273:0:15785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790100583.180277:0:15785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790100583.183780:0:15780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790100583.183844:0:15780:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100583.183883:0:15780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.183910:0:15780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100583.183997:0:15780:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790100583.184001:0:15780:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d67ad05d000 10000000:01000000:3.0:1790100583.184004:0:15780:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d67ad05d000 10000000:01000000:3.0:1790100583.184009:0:15780:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790100583.184016:0:15780:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d67ad05d000 from 1 10000000:01000000:3.0:1790100583.184020:0:15780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790100583.184072:0:15780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900aea00/0x31a8f3fdeeefe18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.184082:0:15780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67900aea00/0x31a8f3fdeeefe18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.184096:0:15780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67900aea00/0x31a8f3fdeeefe18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100583.184158:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790100583.184259:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100583.184322:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126284160 00000100:00100000:3.0:1790100583.184332:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126284160 00000100:00100000:3.0:1790100583.184397:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790100583.184409:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126284160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100583.184424:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100583.184439:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67900af400/0x31a8f3fdeeefe193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe18c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.184467:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67900af400/0x31a8f3fdeeefe193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe18c expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.184479:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67900af400/0x31a8f3fdeeefe193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe18c expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.184488:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67900af400, rc 0) 00000100:00100000:3.0:1790100583.184529:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126284160:12345-0@lo:101:mount.lustre.0 Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100583.184536:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790100583.184588:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678844df00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100583.184645:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790100583.184663:0:15780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67900aea00/0x31a8f3fdeeefe18c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe193 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.184673:0:15780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67900aea00/0x31a8f3fdeeefe18c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe193 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790100583.185453:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790100583.186003:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100583.196593:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790100583.197829:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790100583.197877:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790100583.198174:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790100583.198218:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790100583.198276:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790100583.198314:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790100583.198349:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790100583.198400:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790100583.198437:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790100583.198470:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790100583.198560:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790100583.198596:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790100583.199200:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790100583.199269:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790100583.199311:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790100583.199350:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790100583.199401:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790100583.199438:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790100583.199472:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790100583.199522:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790100583.199561:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790100583.201375:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790100583.201597:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790100583.201662:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790100583.201702:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790100583.201769:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790100583.201842:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790100583.201879:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790100583.203227:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1790100583.203338:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1790100583.203379:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1790100583.203416:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1790100583.203484:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1790100583.203525:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1790100583.203579:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1790100583.203660:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1790100583.203796:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1790100583.203806:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790100583.205408:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100583.205547:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100583.209163:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678844df00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100583.218788:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126284288 00000100:00100000:2.0:1790100583.218813:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126284288 00000100:00100000:2.0:1790100583.218906:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790100583.218919:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126284288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790100583.219380:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126284288:12345-0@lo:501:mount.lustre.0 Request processed in 461us (13831us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100583.219389:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790100583.220214:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790100583.220306:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790100583.220384:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100583.220445:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678844df00 going to sleep for 11 seconds 00000100:00100000:2.0:1790100583.220920:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126284416 00000100:00100000:2.0:1790100583.220937:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126284416 00000100:00100000:2.0:1790100583.221003:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790100583.221014:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126284416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790100583.221382:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126284416:12345-0@lo:503:mount.lustre.0 Request processed in 369us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100583.221392:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790100583.221815:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790100583.223875:0:15780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790100583.227121:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100583.227242:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100583.227360:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787750cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100583.234928:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126284544 00000100:00100000:0.0:1790100583.235022:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126284544 00000100:00100000:0.0:1790100583.236265:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790100583.236289:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126284544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790100583.236842:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126284544:12345-0@lo:502:mount.lustre.0 Request processed in 560us (9598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100583.236864:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790100583.243252:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790100583.243676:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790100583.243776:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790100583.243841:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790100583.245553:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790100583.245711:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790100583.245801:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790100583.245841:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790100583.245875:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790100583.245927:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790100583.248296:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790100583.248395:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790100583.248491:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790100583.248531:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790100583.248565:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790100583.248651:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790100583.248692:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790100583.248737:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790100583.248796:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790100583.248865:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790100583.248902:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790100583.249923:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790100583.250083:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790100583.250121:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790100583.250174:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790100583.250211:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790100583.250246:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790100583.250298:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790100583.250335:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790100583.250367:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790100583.250416:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790100583.250454:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790100583.250489:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790100583.250524:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790100583.250573:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790100583.252743:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790100583.252867:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790100583.252910:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1790100583.253391:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1790100583.253471:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1790100583.253512:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1790100583.253583:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790100583.253750:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100583.253816:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790100583.253916:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126284672 00000100:00100000:3.0:1790100583.253927:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126284672 00000100:00100000:3.0:1790100583.254005:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790100583.254017:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126284672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790100583.254324:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126284672:12345-0@lo:502:mount.lustre.0 Request processed in 308us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100583.254333:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790100583.254539:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126284672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790100583.254684:0:15780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1790100583.254698:0:15780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790100583.256439:0:15790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790100583.256464:0:15790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d6784ed99c0) 00000020:00000080:1.0:1790100583.256492:0:15790:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1790100583.256586:0:15790:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d67ad05d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790100583.256590:0:15790:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d67ad05d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790100583.256593:0:15790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d67ad05d000 3 00010000:00080000:1.0:1790100583.256665:0:15790:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d67857df000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.118@tcp at head 00010000:00010000:1.0:1790100583.258929:0:15790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1790100583.259234:0:15790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790100583.259297:0:15790:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790100583.259318:0:15790:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x31a8f3fdeeefe1a1 00000100:00080000:1.0:1790100583.259332:0:15790:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790100583.259348:0:15790:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d67857df000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1790100583.259404:0:15790:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67bf3fd880 x1877056126284800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790100583.259452:0:15790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790100583.259526:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790100583.259531:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790100583.259533:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790100583.259538:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1790100583.259542:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1790100583.259548:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d678a4bf000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:1.0:1790100583.259574:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67bf3fd500 x1877056126285056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790100583.259668:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126284928:0@lo:400:kworker.0 00000100:00100000:0.0:1790100583.260970:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126285312:0@lo:400:kworker.0 00000100:00100000:2.0:1790100583.261637:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1877056126284800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790100583.261784:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.261845:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100583.261854:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126285184:0@lo:400:kworker.0 00000100:00100000:0.0:1790100583.261881:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.263091:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126285312 00000100:00100000:0.0:1790100583.263108:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126285312 00000100:00100000:0.0:1790100583.263181:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126285184 00000100:00100000:0.0:1790100583.263186:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126285184 00000100:00100000:0.0:1790100583.263210:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790100583.263220:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126285312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100583.263329:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1877056126285312:12345-0@lo:400:kworker.0 Request processed in 109us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100583.263337:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790100583.263358:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790100583.263366:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126285184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100583.263396:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1877056126285184:12345-0@lo:400:kworker.0 Request processed in 32us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100583.263402:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790100583.263423:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790100583.263467:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf3fca80 x1877056126285184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100583.263485:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1877056126285184:0@lo:400:kworker.0 00010000:00080000:0.0:1790100583.263516:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf3fdf80 x1877056126285312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790100583.263538:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1877056126285312:0@lo:400:kworker.0 00000100:00100000:1.0:1790100583.264884:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100583.265079:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126284928 00000100:00100000:0.0:1790100583.265093:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126284928 00000100:00100000:0.0:1790100583.265160:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790100583.265171:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126284928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100583.265246:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126284928:12345-0@lo:400:kworker.0 Request processed in 77us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100583.265254:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790100583.265279:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100583.265401:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100583.265583:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126284928:0@lo:400:kworker.0 00000100:00100000:0.0:1790100583.265866:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126284800 00000100:00100000:0.0:1790100583.265872:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126284800 00000100:00100000:0.0:1790100583.265907:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790100583.265913:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1877056126284800:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790100583.266018:0:14383:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1790100583.266078:0:14383:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x31a8f3fdeeefe1a8 00000004:00100000:0.0:1790100583.266098:0:14383:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790100583.266144:0:14383:0:(import.c:65:import_set_state_nolock()) ffff8d67b5a25000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790100583.266199:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877056126284800:12345-0@lo:38:llog_process_th.0 Request processed in 284us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100583.266206:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790100583.266667:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67bf3fd880 x1877056126284800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790100593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100583.266681:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790100583.266691:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1790100583.266702:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790100583.266710:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790100583.266712:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d67857df000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790100583.266719:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1877056126284800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790100583.266741:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126285056:0@lo:8:kworker.0 00000100:00100000:2.0:1790100583.266797:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1790100583.267338:0:15790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1790100583.267603:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126285056 00000100:00100000:0.0:1790100583.267643:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126285056 00000100:00100000:0.0:1790100583.267685:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100583.267694:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1877056126285056:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790100583.267798:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1877056126285056:12345-0@lo:8:kworker.0 Request processed in 104us (1000us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790100583.267826:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100583.267870:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790100583.267877:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790100583.267882:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790100583.267886:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126285056:0@lo:8:kworker.0 00000020:01000000:3.0:1790100583.268189:0:15780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790100583.268241:0:15780:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790100583.268297:0:15780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900aea00/0x31a8f3fdeeefe18c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe193 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.268310:0:15780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67900aea00/0x31a8f3fdeeefe18c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe193 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790100583.268372:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790100583.268374:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790100583.268376:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100583.268377:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100583.268379:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100583.268380:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100583.268382:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100583.268384:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100583.268385:0:15780:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790100583.268390:0:15780:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1790100583.268392:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790100583.268393:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790100583.268395:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100583.268396:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100583.268397:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100583.268398:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100583.268399:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100583.268400:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100583.268400:0:15780:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790100583.268432:0:15780:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790100583.268456:0:15780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126285440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790100583.268510:0:15780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100583.268554:0:15780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787750540 going to sleep for 11 seconds 00000100:00100000:0.0:1790100583.270068:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126285440 00000100:00100000:0.0:1790100583.270085:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126285440 00000100:00100000:0.0:1790100583.270185:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790100583.270198:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:15780:x1877056126285440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790100583.270241:0:14374:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790100583.270261:0:14374:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790100583.318427:0:14374:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790100583.318486:0:14374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790100583.326557:0:14397:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790100583.326574:0:14397:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790100583.326635:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.326659:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe07b expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.326668:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.326767:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefe07b expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.326785:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe07b expref: 19 pid: 14374 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100583.326804:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1877056126285568:0@lo:104: 00000100:00100000:2.0:1790100583.326912:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100583.327007:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a943a600 going to sleep for 11 seconds 00000100:00100000:3.0:1790100583.327120:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126285568 00000100:00100000:3.0:1790100583.327131:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126285568 00000100:00100000:3.0:1790100583.327202:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790100583.327215:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:14397:x1877056126285568:12345-0@lo:104: 00010000:00010000:3.0:1790100583.327231:0:14366:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.327304:0:14366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100583.327311:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:14397:x1877056126285568:12345-0@lo:104: Request processed in 100us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100583.327319:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790100583.327345:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100583.327353:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.327361:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1790100583.327366:0:14371:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.327376:0:14371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100583.327383:0:14371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100583.327389:0:14371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790100583.327432:0:14371:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.327439:0:14371:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100583.327468:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.327475:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67ad819000/0x31a8f3fdeeefe07b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefe082 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.327496:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100583.327498:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100583.327499:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100583.327762:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14397:1877056126285568:0@lo:104: 00010000:00010000:2.0:1790100583.327788:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100583.328124:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790100583.328143:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126285696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100583.328200:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100583.328309:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126285696 00000100:00100000:2.0:1790100583.328318:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126285696 00010000:00010000:2.0:1790100583.328351:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe07b expref: 20 pid: 14374 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100583.328392:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100583.328401:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+20:3312:x1877056126285696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790100583.328417:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100583.328423:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe07b expref: 20 pid: 14374 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328434:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe07b expref: 20 pid: 14374 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328452:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67b5e13600/0x31a8f3fdeeefe082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefe07b expref: 20 pid: 14374 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328481:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328489:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790100583.328506:0:14369:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003270993s 00010000:00010000:2.0:1790100583.328512:0:14369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328519:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328527:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328534:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328540:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100583.328545:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328553:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328576:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100583.328586:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790100583.328673:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3312:x1877056126285696:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100583.328681:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1790100583.328772:0:14397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.328782:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100583.328788:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe1af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100583.328888:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126285696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790100583.335218:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:15780:x1877056126285440:12345-0@lo:253:mount.lustre.0 Request processed in 65006us (66690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100583.335240:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790100583.335376:0:15780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:15780:1877056126285440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790100583.335399:0:15780:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790100583.335405:0:15780:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790100583.335407:0:15780:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790100583.335409:0:15780:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790100583.335410:0:15780:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790100583.335411:0:15780:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790100583.335413:0:15780:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790100583.335414:0:15780:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790100583.335416:0:15780:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790100583.335418:0:15780:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790100583.335460:0:15780:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790100583.344261:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790100583.344513:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790100583.345391:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100583.345579:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790100583.346425:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790100583.347162:0:15780:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790100583.349261:0:15780:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790100583.410818:0:15780:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1790100583.410829:0:15780:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1790100583.410877:0:15780:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790100583.410980:0:15780:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790100583.411004:0:15780:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790100583.411053:0:15780:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790100583.782343:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100584.808168:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790100585.062372:0:14378:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790100585.062394:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6682507800 from 8 10000000:01000000:3.0:1790100585.062401:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790100585.062479:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefe1b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100585.062495:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefe1b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100585.062509:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefe1b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100585.062550:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126285824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100585.064104:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100585.064195:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6784f82780 going to sleep for 11 seconds 00000100:00100000:1.0:1790100585.064346:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126285824 00000100:00100000:1.0:1790100585.064358:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126285824 00000100:00100000:1.0:1790100585.064433:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790100585.064445:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:14378:x1877056126285824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100585.064464:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100585.064488:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67b5e12800/0x31a8f3fdeeefe1bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe1b6 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100585.064521:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67b5e12800/0x31a8f3fdeeefe1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe1b6 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100585.064556:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67b5e12800/0x31a8f3fdeeefe1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe1b6 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100585.064566:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12800, rc 0) 00000100:00100000:1.0:1790100585.064647:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:14378:x1877056126285824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100585.064654:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790100585.064731:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126285824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100585.064753:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefe1b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe1bd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100585.064763:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefe1b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe1bd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100585.065170:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126285952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790100585.065220:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100585.065257:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787afe480 going to sleep for 11 seconds 00000100:00100000:2.0:1790100585.065801:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126285952 00000100:00100000:2.0:1790100585.065810:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126285952 00000100:00100000:2.0:1790100585.065878:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790100585.065887:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:14378:x1877056126285952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790100585.065912:0:14374:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790100585.066172:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790100585.066176:0:14374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1790100585.066325:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:14378:x1877056126285952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 438us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100585.066336:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790100585.066504:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126285952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790100585.066590:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790100585.066602:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefe1b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe1bd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100585.066648:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67900ae000/0x31a8f3fdeeefe1b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe1bd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100585.707886:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126286080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100585.707984:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100585.708602:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126286080 00000100:00100000:0.0:1790100585.708633:0:15067:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126286080 00000100:00100000:0.0:1790100585.708728:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790100585.708742:0:15067:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126286080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790100585.708794:0:15067:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100585.718725:0:15067:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126286080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9969us (10723us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100585.718748:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790100585.718818:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100585.724881:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126286080:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790100585.829880:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100586.854848:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100587.878079:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790100588.262084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790100588.262092:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790100588.262097:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790100588.262118:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d678a4bf000 using connection 192.168.201.118@tcp/0@lo 00000100:00100000:0.0:1790100588.262145:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67b5a83800 x1877056126286464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790100588.262229:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126286464:0@lo:8:kworker.0 00000100:00100000:3.0:1790100588.262244:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126286336:0@lo:400:kworker.0 00000100:00100000:2.0:1790100588.262321:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126286208:0@lo:400:kworker.0 00000100:00100000:1.0:1790100588.262476:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126286592:0@lo:400:kworker.0 00000100:00100000:3.0:1790100588.264236:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100588.264361:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126286720:0@lo:400:kworker.0 00000100:00100000:3.0:1790100588.264409:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100588.264451:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126286336 00000100:00100000:3.0:1790100588.264462:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126286336 00000100:00100000:3.0:1790100588.264533:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100588.264543:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126286336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100588.264629:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126286336:12345-0@lo:400:kworker.0 Request processed in 69us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100588.264636:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790100588.264682:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126286720 00000100:00100000:3.0:1790100588.264686:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126286720 00000100:00100000:3.0:1790100588.264716:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790100588.264723:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126286720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100588.264760:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126286720:12345-0@lo:400:kworker.0 Request processed in 38us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100588.264767:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790100588.264784:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790100588.264790:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790100588.264830:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67b5a83480 x1877056126286720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100588.264845:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126286720:0@lo:400:kworker.0 00000100:00100000:3.0:1790100588.264877:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126286336:0@lo:400:kworker.0 00000100:00100000:2.0:1790100588.265477:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100588.265517:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126286848:0@lo:400:kworker.0 00000100:00100000:2.0:1790100588.265546:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100588.265583:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126286848 00000100:00100000:2.0:1790100588.265590:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126286848 00000100:00100000:2.0:1790100588.265653:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790100588.265662:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126286848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100588.265727:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126286848:12345-0@lo:400:kworker.0 Request processed in 67us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100588.265734:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1790100588.265782:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67b5a82680 x1877056126286848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100588.265795:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126286848:0@lo:400:kworker.0 00000100:00100000:3.0:1790100588.266190:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126286208 00000100:00100000:3.0:1790100588.266205:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126286208 00000100:00100000:3.0:1790100588.266251:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790100588.266260:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3313:x1877056126286208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100588.266310:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3313:x1877056126286208:12345-0@lo:400:kworker.0 Request processed in 52us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100588.266316:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790100588.266346:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100588.266371:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126286208:0@lo:400:kworker.0 00000100:00100000:0.0:1790100588.269675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100588.274684:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126286464 00000100:00100000:3.0:1790100588.274708:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126286464 00000100:00100000:3.0:1790100588.274787:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790100588.274798:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1877056126286464:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790100588.274844:0:15066:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:3.0:1790100588.274901:0:15066:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x31a8f3fdeeefe1c4 00002000:00100000:3.0:1790100588.274922:0:15066:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d66824c6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790100588.274927:0:15066:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790100588.274930:0:15066:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790100588.275376:0:15066:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790100588.275412:0:15066:0:(import.c:65:import_set_state_nolock()) ffff8d66824c5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100588.275541:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1877056126286464:12345-0@lo:8:kworker.0 Request processed in 743us (5877us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100588.275550:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790100588.275675:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67b5a83800 x1877056126286464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790100613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790100588.275697:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790100588.275707:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790100588.275733:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790100588.275736:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d678a4bf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790100588.275765:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790100588.275772:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1877056126286464:0@lo:8:kworker.0 00000004:00080000:3.0:1790100588.275853:0:14406:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1790100588.275877:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14406:1877056126287104:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790100588.275926:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100588.275953:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d678b0436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790100588.275974:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126287104 00000100:00100000:3.0:1790100588.275980:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126287104 00000100:00100000:3.0:1790100588.276026:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100588.276035:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14406:x1877056126287104:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790100588.279710:0:14405:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790100588.280890:0:14405:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 484850276443ns, next at 0ns, rc = 0 00000100:00100000:1.0:1790100588.284985:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100588.289437:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126286592 00000100:00100000:3.0:1790100588.289459:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126286592 00000100:00100000:3.0:1790100588.289529:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790100588.289541:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126286592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100588.289698:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126286592:12345-0@lo:400:kworker.0 Request processed in 159us (4725us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100588.289706:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1790100588.289740:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790100588.289765:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126286976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100588.289813:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790100588.293160:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67b5a80700 x1877056126286592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790100588.293185:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126286592:0@lo:400:kworker.0 00000100:00100000:2.0:1790100588.295280:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126286976 00000100:00100000:2.0:1790100588.295302:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126286976 00000100:00100000:2.0:1790100588.295401:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100588.295414:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877056126286976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100588.295465:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100588.295592:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1877056126286976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (5776us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100588.295600:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790100588.297145:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67bf975880 x1877056126286976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790100604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790100588.297185:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126286976:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1790100588.297792:0:15063:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790100588.297811:0:15063:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1790100588.297817:0:15063:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1790100588.313225:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.313244:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313269:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.313276:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.313284:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313309:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313323:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313330:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313362:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100588.313379:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100588.313387:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313397:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900afc00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100588.313402:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313422:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313444:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313453:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe1cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.313474:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.313476:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.313478:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.316428:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.316445:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316469:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.316474:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.316483:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316500:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316512:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316527:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316561:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100588.316582:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100588.316590:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316600:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100588.316605:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316652:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316674:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316683:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe1d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.316704:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.316706:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.316707:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.318596:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.318673:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.318697:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.318703:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.318710:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.318730:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.318744:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.318753:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.318775:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100588.318793:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100588.318801:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.318811:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100588.318817:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.318828:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.318859:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.318866:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe1d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.319125:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.319128:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.319130:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.319755:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.319765:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.319780:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.319784:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.319789:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.319802:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.319811:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.319818:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.319848:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100588.319862:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100588.319867:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.319874:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100588.321390:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.321412:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.321439:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.321448:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068fc2e7f/0x31a8f3fdeeefe1e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.321482:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.321485:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.321487:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.322390:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.322401:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322418:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.322430:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.322438:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322454:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322466:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322476:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322505:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100588.322523:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100588.322532:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322541:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aee00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100588.322546:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322556:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322571:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322591:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce023b07/0x31a8f3fdeeefe1e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.322634:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.322637:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.322639:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.323094:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.323100:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323111:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.323115:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.323119:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323130:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323140:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323148:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323165:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100588.323174:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100588.323185:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323193:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900aec00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100588.323197:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323206:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323218:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323227:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8546a4/0x31a8f3fdeeefe1ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323243:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.323245:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.323246:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.323720:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.323727:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323737:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.323741:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.323746:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323766:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323775:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323783:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323799:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100588.323809:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100588.323815:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323823:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100588.323826:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323835:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323847:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323856:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069e6693e/0x31a8f3fdeeefe1f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.323877:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.323879:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.323880:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.327214:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.327234:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327255:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.327261:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.327269:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327287:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327299:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327308:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327333:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790100588.327351:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100588.327358:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327383:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100588.327389:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327400:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327419:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327426:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81571d2/0x31a8f3fdeeefe1fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.327449:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.327451:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.327453:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.331329:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.331345:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.331370:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.331377:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.331385:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.331402:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.331421:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.331431:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.331452:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.331775:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.331786:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.331796:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.331802:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.331813:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.331838:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.331846:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a45aad82/0x31a8f3fdeeefe203 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.331893:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.331895:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.331898:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.331933:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.331939:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.331948:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.331952:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.331956:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.331966:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.331975:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.331982:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332017:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.332091:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.332097:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332106:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900afc00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.332109:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332118:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332130:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332138:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003689a78b/0x31a8f3fdeeefe20a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332152:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.332154:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.332156:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.332411:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.332418:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332428:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.332431:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.332436:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332445:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332454:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332462:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332483:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.332662:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.332668:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332687:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900af200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.332691:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332700:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332712:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332720:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e68e59e8/0x31a8f3fdeeefe211 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.332732:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.332734:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.332735:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.332912:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.332918:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332927:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.332936:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.332940:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332950:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332959:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332968:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.332990:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.333051:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.333057:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.333065:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781522200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.333069:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.333078:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.333103:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.333111:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a109d4/0x31a8f3fdeeefe218 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.333125:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.333127:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.333129:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.333425:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.333431:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.333440:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.333443:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.333447:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.333456:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.333465:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.333478:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.333500:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.334043:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.334051:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.334059:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781522600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.334063:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.334072:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.334085:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.334092:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005657916c/0x31a8f3fdeeefe21f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.334124:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.334127:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.334129:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.334568:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.334576:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.334589:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.334593:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.334598:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.334656:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.334666:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.334673:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.334687:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790100588.335150:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.335158:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.335174:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.335176:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.335180:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335186:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100588.335191:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335192:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.335200:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335201:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.335206:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.335207:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335216:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.335225:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.335231:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335238:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005523c2a9/0x31a8f3fdeeefe226 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335256:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.335260:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335266:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523e00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.335276:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335284:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335294:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335302:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e803d7e8/0x31a8f3fdeeefe22d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.335314:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.335315:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.335317:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.335671:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.335677:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.335686:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.335690:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.335693:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.335704:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.335724:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.335732:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.335755:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.336024:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.336030:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336038:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.336042:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336050:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336063:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336077:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081742eb2/0x31a8f3fdeeefe234 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336091:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.336094:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.336095:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.336161:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.336168:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336177:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.336180:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.336184:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336194:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336203:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336212:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336244:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.336658:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.336664:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336673:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781522e00 already unused, calling callback (ffffffffc1718900) 00002000:00010000:3.0:1790100588.336675:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790100588.336677:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336681:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336687:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336689:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.336693:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.336698:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336699:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336707:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ede14ac/0x31a8f3fdeeefe23b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336708:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336716:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.336724:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336724:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.336725:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.336727:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100588.336734:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.336736:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.336740:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336747:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781522c00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.336750:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336758:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336769:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336776:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078424fdb/0x31a8f3fdeeefe242 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.336788:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.336790:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.336792:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.337146:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.337153:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.337162:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.337171:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.337175:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.337186:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.337195:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.337201:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.337224:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.337334:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.337340:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.337347:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.337350:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.337370:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.337383:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.337390:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7851274/0x31a8f3fdeeefe249 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.337405:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.337407:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.337409:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100588.337964:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790100588.348776:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1790100588.349163:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.349176:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349199:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.349205:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.349213:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349232:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349245:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349261:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349290:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790100588.349893:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.349900:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349912:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.349915:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.349919:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349930:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349939:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349945:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.349959:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790100588.350070:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100588.350079:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350089:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.350095:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350106:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350128:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350161:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086461d00/0x31a8f3fdeeefe250 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350185:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.350188:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350195:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6781523c00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.350198:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350205:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350215:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350221:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000276f1be/0x31a8f3fdeeefe257 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350231:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.350233:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.350234:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.350394:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.350400:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.350415:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.350419:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.350423:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.350433:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.350442:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.350450:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.350472:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790100588.350602:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.350607:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350639:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae600 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.350653:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350662:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350674:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350682:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be67ac4c/0x31a8f3fdeeefe25e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.350697:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.350698:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.350700:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.350919:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.350925:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.350933:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.350936:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.350940:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.350949:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.350971:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.350977:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.351000:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790100588.351426:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.351433:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.351443:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.351446:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.351450:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.351461:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.351470:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.351477:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.351497:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790100588.351841:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790100588.351849:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.351857:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fec00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.351861:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.351870:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.351878:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790100588.351891:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.351911:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe265 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.351936:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.351939:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.351941:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790100588.353801:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.353816:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.353837:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.353843:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.353850:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.353869:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.353882:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.353891:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.353911:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790100588.354384:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.354392:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354403:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.354411:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.354416:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354426:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354435:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354443:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354451:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790100588.354873:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790100588.354880:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354890:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1790100588.354894:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100588.354898:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354907:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354915:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354929:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100588.354937:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1790100588.355111:0:15063:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1790100588.355253:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14406:x1877056126287104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 79214us (79321us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100588.355265:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100588.355352:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14406:1877056126287104:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790100588.355375:0:14406:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1790100588.355435:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bb9f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14406:1877056126287232:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790100588.355476:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100588.355523:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6799ce5540 going to sleep for 11 seconds 00000100:00100000:3.0:1790100588.355547:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126287232 00000100:00100000:3.0:1790100588.355555:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126287232 00000100:00100000:3.0:1790100588.355602:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790100588.355656:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14406:x1877056126287232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790100588.355703:0:15064:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1790100588.356800:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790100588.356813:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356828:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fe000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100588.356834:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356846:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356875:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356883:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008016c611/0x31a8f3fdeeefe273 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356915:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790100588.356919:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356926:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21ff200 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100588.356930:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356939:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356964:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356971:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a2c88c/0x31a8f3fdeeefe27a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356987:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100588.356991:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.356997:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21ffa00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100588.357000:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.357019:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.357030:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.357037:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c359b06e/0x31a8f3fdeeefe281 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100588.357050:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100588.357052:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100588.357059:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.357093:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.357096:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.357098:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.358367:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.358385:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fea00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100588.358389:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.358400:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.358418:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.358426:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe26c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100588.358456:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.358458:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100588.358460:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100588.368876:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14406:x1877056126287232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13251us (13385us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790100588.368895:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790100588.369687:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bb9f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14406:1877056126287232:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790100588.369711:0:14406:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1790100588.919545:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790100588.936148:0:7647:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1790100588.936220:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1790100589.926010:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100590.822867:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100590.822892:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126287360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100590.822974:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100590.823044:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126287360 00000100:00100000:2.0:1790100590.823053:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126287360 00000100:00100000:2.0:1790100590.823120:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100590.823132:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126287360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100590.823189:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100590.823244:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126287360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100590.823263:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790100590.823284:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100590.826924:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126287360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790100590.952429:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100591.980961:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790100592.095117:0:16137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg118-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1790100592.426630:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790100592.999145:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100593.382115:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126287872:0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.382256:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100593.382333:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790100593.382340:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3311:1877056126287488:0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.382375:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100593.382400:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126288000:0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.382420:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100593.382449:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126287616:0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.382479:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100593.382500:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126288128:0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.382520:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100593.382538:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790100593.382542:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126287744:0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.382582:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100593.382647:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126287872 00000100:00100000:2.0:1790100593.382659:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126287872 00000100:00100000:2.0:1790100593.382712:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126288000 00000100:00100000:2.0:1790100593.382715:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126288000 00000100:00100000:2.0:1790100593.382742:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126288128 00000100:00100000:2.0:1790100593.382746:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126288128 00000100:00100000:2.0:1790100593.382768:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100593.382780:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126287872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.382860:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126287872:12345-0@lo:400:kworker.0 Request processed in 82us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100593.382869:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100593.382891:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100593.382896:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126288000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.382925:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126288000:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100593.382930:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100593.382941:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100593.382946:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126288128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.382975:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126288128:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100593.382981:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100593.383003:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126287488 00000100:00100000:2.0:1790100593.383007:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126287488 00000100:00100000:2.0:1790100593.383038:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790100593.383045:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3311:x1877056126287488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.383074:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3311:x1877056126287488:12345-0@lo:400:kworker.0 Request processed in 31us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100593.383080:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790100593.383116:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126287616 00000100:00100000:2.0:1790100593.383120:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126287616 00000100:00100000:2.0:1790100593.383149:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126287744 00000100:00100000:2.0:1790100593.383151:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126287744 00000100:00100000:2.0:1790100593.383166:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100593.383172:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126287616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.383212:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126287616:12345-0@lo:400:kworker.0 Request processed in 40us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100593.383218:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790100593.383231:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790100593.383237:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126287744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.383265:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126287744:12345-0@lo:400:kworker.0 Request processed in 28us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100593.383271:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1790100593.383297:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100593.383302:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100593.383305:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100593.383348:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790100593.383369:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126287744:0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.383382:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126287616:0@lo:400:kworker.0 00010000:00080000:2.0:1790100593.383395:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66839cb100 x1877056126288128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100593.383405:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126288128:0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.383435:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3311:1877056126287488:0@lo:400:kworker.0 00010000:00080000:2.0:1790100593.383445:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66839cb480 x1877056126288000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100593.383453:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126288000:0@lo:400:kworker.0 00010000:00080000:2.0:1790100593.383463:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d66839c9880 x1877056126287872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790100609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790100593.383482:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126287872:0@lo:400:kworker.0 00000100:00100000:2.0:1790100593.383892:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126288256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100593.383939:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100593.384420:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126288256 00000100:00100000:0.0:1790100593.384430:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126288256 00000100:00100000:0.0:1790100593.384485:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100593.384495:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126288256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790100593.384532:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790100593.384603:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126288256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100593.384632:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790100593.384767:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126288256:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790100594.023036:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790100595.049584:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100595.102446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.102520:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109518720 00000100:00100000:2.0:1790100595.102542:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109518720 00000100:00100000:2.0:1790100595.102599:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:2.0:1790100595.102607:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2356:x1877056109518720:12345-192.168.201.18@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790100595.102673:0:14376:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 60e402f9-88fa-42cc-ac17-8cdf00c9f9ee@192.168.201.18@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1790100595.102706:0:14376:0:(genops.c:1384:class_connect()) connect: client 60e402f9-88fa-42cc-ac17-8cdf00c9f9ee, cookie 0x31a8f3fdeeefe288 00000100:00080000:2.0:1790100595.102850:0:14376:0:(import.c:65:import_set_state_nolock()) ffff8d678309b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100595.102930:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+5:2356:x1877056109518720:12345-192.168.201.18@tcp:250:mount.lustre.0 Request processed in 322us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.102939:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 77 00000100:00100000:0.0:1790100595.108225:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.108350:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109518848 00000100:00100000:2.0:1790100595.108360:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109518848 00000100:00100000:2.0:1790100595.108473:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:2.0:1790100595.108485:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+5:13760:x1877056109518848:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100595.108503:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100595.108522:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6785142a00/0x31a8f3fdeeefe28f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64fc1 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.108571:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6785142a00/0x31a8f3fdeeefe28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fc1 expref: 6 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.108606:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6785142a00/0x31a8f3fdeeefe28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fc1 expref: 6 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.108654:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142a00, rc 0) 00000100:00100000:2.0:1790100595.108717:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+6:13760:x1877056109518848:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 235us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.108727:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 78 00000100:00100000:2.0:1790100595.125670:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100595.126181:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109518976 00000100:00100000:0.0:1790100595.126194:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109518976 00000100:00100000:0.0:1790100595.126260:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:0.0:1790100595.126271:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad04b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+6:13760:x1877056109518976:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790100595.127265:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad04b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+6:13760:x1877056109518976:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 989us (1609us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790100595.127285:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 79 00000100:00100000:0.0:1790100595.145681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.155057:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109519104 00000100:00100000:2.0:1790100595.155074:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109519104 00000100:00100000:2.0:1790100595.155303:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:2.0:1790100595.155315:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+6:13760:x1877056109519104:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100595.155334:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100595.155355:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6785142200/0x31a8f3fdeeefe296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64fc8 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.155382:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6785142200/0x31a8f3fdeeefe296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fc8 expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.155393:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6785142200/0x31a8f3fdeeefe296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64fc8 expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.155402:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142200, rc 0) 00000100:00100000:2.0:1790100595.155499:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+7:13760:x1877056109519104:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 185us (9826us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.155507:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 80 00000100:00100000:1.0:1790100595.171512:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.171697:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109519232 00000100:00100000:2.0:1790100595.171709:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109519232 00000100:00100000:2.0:1790100595.171763:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:2.0:1790100595.171773:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+7:13760:x1877056109519232:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790100595.172087:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+8:13760:x1877056109519232:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 316us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.172095:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 81 00000100:00100000:0.0:1790100595.177542:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.182147:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109519360 00000100:00100000:2.0:1790100595.182167:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109519360 00000100:00100000:0.0:1790100595.182444:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:0.0:1790100595.182456:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+8:13760:x1877056109519360:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790100595.182795:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+8:13760:x1877056109519360:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 339us (5271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100595.183793:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 82 00000100:00100000:1.0:1790100595.199444:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100595.199597:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109519488 00000100:00100000:3.0:1790100595.199607:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109519488 00000100:00100000:3.0:1790100595.199718:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:3.0:1790100595.199729:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+8:13779:x1877056109519488:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790100595.200068:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+8:13779:x1877056109519488:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 340us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100595.200078:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 83 00000100:00100000:1.0:1790100595.231338:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100595.231435:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109519616 00000100:00100000:3.0:1790100595.231446:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109519616 00000100:00100000:3.0:1790100595.231507:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:3.0:1790100595.231517:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+8:13779:x1877056109519616:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790100595.232308:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+8:13779:x1877056109519616:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 788us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100595.232319:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 84 00000100:00100000:2.0:1790100595.247792:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100595.248552:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109519744 00000100:00100000:0.0:1790100595.248565:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109519744 00000100:00100000:0.0:1790100595.248668:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:0.0:1790100595.248680:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+8:13760:x1877056109519744:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790100595.248697:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100595.248714:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad819600/0x31a8f3fdeeefe29d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ff2 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100595.248745:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad819600/0x31a8f3fdeeefe29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff2 expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100595.248756:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad819600/0x31a8f3fdeeefe29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff2 expref: 9 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100595.248775:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819600, rc 0) 00000100:00100000:0.0:1790100595.248853:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+9:13760:x1877056109519744:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 175us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100595.248860:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 85 00000100:00100000:1.0:1790100595.258887:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100595.259142:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109519872 00000100:00100000:3.0:1790100595.259156:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109519872 00000100:00100000:3.0:1790100595.259224:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:3.0:1790100595.259235:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+9:13760:x1877056109519872:12345-192.168.201.18@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790100595.259265:0:14374:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790100595.259294:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790100595.259298:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790100595.259302:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790100595.259304:0:14374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1790100595.267285:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+9:13760:x1877056109519872:12345-192.168.201.18@tcp:256:mount.lustre.0 Request processed in 8042us (8398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100595.267300:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 86 00000100:00100000:2.0:1790100595.275158:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100595.275417:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109520000 00000100:00100000:3.0:1790100595.275429:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109520000 00000100:00100000:3.0:1790100595.275505:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:3.0:1790100595.275516:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+9:13760:x1877056109520000:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790100595.275540:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100595.275558:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc64ff9 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100595.275589:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff9 expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100595.275601:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff9 expref: 10 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100595.275651:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21ff000, rc 0) 00000100:00100000:3.0:1790100595.275705:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13760:x1877056109520000:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 191us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100595.275712:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 87 00000100:00100000:1.0:1790100595.281250:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100595.281568:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109520128 00000100:00100000:3.0:1790100595.281579:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109520128 00000100:00100000:3.0:1790100595.281790:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:3.0:1790100595.281816:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13760:x1877056109520128:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790100595.282118:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13760:x1877056109520128:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 304us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100595.282127:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 88 00000100:00100000:1.0:1790100595.295145:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100595.295255:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109520256 00000100:00100000:0.0:1790100595.295265:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109520256 00000100:00100000:0.0:1790100595.295328:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:0.0:1790100595.295338:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66811ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13760:x1877056109520256:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790100595.295638:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66811ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13760:x1877056109520256:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 298us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100595.295647:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 89 00000100:00100000:3.0:1790100595.302924:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.303065:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109520384 00000100:00100000:2.0:1790100595.303075:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109520384 00000100:00100000:2.0:1790100595.303128:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:2.0:1790100595.303138:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13783:x1877056109520384:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790100595.303387:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13783:x1877056109520384:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 250us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.303396:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 90 00000100:00100000:1.0:1790100595.323241:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.329188:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109520512 00000100:00100000:2.0:1790100595.329206:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109520512 00000100:00100000:2.0:1790100595.329286:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:2.0:1790100595.329297:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13783:x1877056109520512:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790100595.329593:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13783:x1877056109520512:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 297us (6364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.329602:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 91 00000100:00100000:1.0:1790100595.364580:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.364732:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109520640 00000100:00100000:2.0:1790100595.364771:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109520640 00000100:00100000:2.0:1790100595.364836:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:2.0:1790100595.364845:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1877056109520640:12345-192.168.201.18@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790100595.364880:0:14381:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 18e88987-66d0-4240-a27c-27ca03f877ad@192.168.201.18@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1790100595.364934:0:14381:0:(genops.c:1384:class_connect()) connect: client 18e88987-66d0-4240-a27c-27ca03f877ad, cookie 0x31a8f3fdeeefe2ab 00000004:00100000:2.0:1790100595.364964:0:14381:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1790100595.364970:0:14381:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1790100595.415427:0:14381:0:(import.c:65:import_set_state_nolock()) ffff8d66824c0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790100595.415538:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+6:2356:x1877056109520640:12345-192.168.201.18@tcp:38:mount.lustre.0 Request processed in 50674us (50949us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100595.415569:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:0.0:1790100595.419159:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100595.419267:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109520768 00000100:00100000:1.0:1790100595.419277:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109520768 00000100:00100000:1.0:1790100595.419363:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:1.0:1790100595.419376:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+6:0:x1877056109520768:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790100595.419422:0:14382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790100595.419509:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+6:0:x1877056109520768:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 137us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100595.419517:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00080000:3.0:1790100595.419973:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100595.422279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100595.422364:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109520896 00000100:00100000:3.0:1790100595.422373:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109520896 00000100:00100000:3.0:1790100595.422429:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1790100595.422439:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+6:13760:x1877056109520896:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790100595.422469:0:14381:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790100595.422548:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+6:13760:x1877056109520896:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100595.422555:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1790100595.425180:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100595.425282:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109521024 00000100:00100000:0.0:1790100595.425294:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109521024 00000100:00100000:0.0:1790100595.425355:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1790100595.425365:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+6:13760:x1877056109521024:12345-192.168.201.18@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790100595.425455:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+6:13760:x1877056109521024:12345-192.168.201.18@tcp:40:mount.lustre.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100595.425462:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1790100595.428700:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.428976:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109521152 00000100:00100000:2.0:1790100595.428987:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109521152 00000100:00100000:2.0:1790100595.429043:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:2.0:1790100595.429052:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1877056109521152:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790100595.429085:0:15066:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 18e88987-66d0-4240-a27c-27ca03f877ad@192.168.201.18@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1790100595.429118:0:15066:0:(genops.c:1384:class_connect()) connect: client 18e88987-66d0-4240-a27c-27ca03f877ad, cookie 0x31a8f3fdeeefe2b2 00002000:00100000:2.0:1790100595.429130:0:15066:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 18e88987-66d0-4240-a27c-27ca03f877ad/ffff8d678309a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790100595.429154:0:15066:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790100595.429486:0:15066:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790100595.429519:0:15066:0:(import.c:65:import_set_state_nolock()) ffff8d6799d93000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100595.429594:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e88987-66d0-4240-a27c-27ca03f877ad+6:2356:x1877056109521152:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 542us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.429601:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:1.0:1790100595.435097:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.435352:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109521280 00000100:00100000:2.0:1790100595.435363:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109521280 00000100:00100000:2.0:1790100595.435415:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:2.0:1790100595.435424:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1877056109521280:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790100595.435460:0:15064:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 18e88987-66d0-4240-a27c-27ca03f877ad@192.168.201.18@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1790100595.435513:0:15064:0:(genops.c:1384:class_connect()) connect: client 18e88987-66d0-4240-a27c-27ca03f877ad, cookie 0x31a8f3fdeeefe2b9 00002000:00100000:2.0:1790100595.435536:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 18e88987-66d0-4240-a27c-27ca03f877ad/ffff8d6799d95000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790100595.435562:0:15064:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790100595.436121:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790100595.436153:0:15064:0:(import.c:65:import_set_state_nolock()) ffff8d6799d92800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100595.436335:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18e88987-66d0-4240-a27c-27ca03f877ad+6:2356:x1877056109521280:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 908us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.436343:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1790100595.439291:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100595.440724:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109521408 00000100:00100000:0.0:1790100595.440861:0:14384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109521408 00000100:00100000:0.0:1790100595.440966:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1790100595.440978:0:14384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e88987-66d0-4240-a27c-27ca03f877ad+6:13760:x1877056109521408:12345-192.168.201.18@tcp:33:mount.lustre.0 00000004:00080000:2.0:1790100595.443102:0:14384:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2052us 00000004:00200000:2.0:1790100595.456560:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790100595.456924:0:14384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e88987-66d0-4240-a27c-27ca03f877ad+6:13760:x1877056109521408:12345-192.168.201.18@tcp:33:mount.lustre.0 Request processed in 15940us (17633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.456959:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1790100595.737943:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100595.738176:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109521536 00000100:00100000:2.0:1790100595.738187:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109521536 00000100:00100000:2.0:1790100595.738254:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1790100595.738265:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+6:13804:x1877056109521536:12345-192.168.201.18@tcp:101:mkdir.0 00010000:00010000:2.0:1790100595.738287:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100595.738315:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe2c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65023 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.738394:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe2c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.738408:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.738440:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100595.738477:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790100595.738480:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100595.738528:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.738552:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe2c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65023 expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.738570:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65023 expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100595.738578:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787defd00) 00010000:00010000:2.0:1790100595.738580:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100595.738584:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142000, rc 0) 00000100:00100000:2.0:1790100595.738702:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+7:13804:x1877056109521536:12345-192.168.201.18@tcp:101:mkdir.0 Request processed in 437us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.738709:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:0.0:1790100595.947585:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126288384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100595.947698:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100595.948024:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126288384 00000100:00100000:2.0:1790100595.948033:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126288384 00000100:00100000:2.0:1790100595.948112:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790100595.948122:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126288384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100595.948148:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100595.948211:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126288384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100595.948235:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790100595.948331:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126288384:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790100595.948413:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790100596.070055:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790100597.062764:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 18e88987-66d0-4240-a27c-27ca03f877ad 00010000:00010000:0.0:1790100597.094074:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100597.856673:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100597.857760:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109521664 00000100:00100000:3.0:1790100597.857773:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109521664 00000100:00100000:3.0:1790100597.857872:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1790100597.857886:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+7:13856:x1877056109521664:12345-192.168.201.18@tcp:41:lfs.0 00000004:00000024:3.0:1790100597.857938:0:14381:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790100597.858048:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+7:13856:x1877056109521664:12345-192.168.201.18@tcp:41:lfs.0 Request processed in 165us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100597.858056:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00080000:2.0:1790100597.858370:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100597.865704:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100597.866860:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109521792 00000100:00100000:2.0:1790100597.866880:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109521792 00000100:00100000:2.0:1790100597.866977:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:2.0:1790100597.866989:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:18e88987-66d0-4240-a27c-27ca03f877ad+5:13856:x1877056109521792:12345-192.168.201.18@tcp:13:lfs.0 00002000:00000024:2.0:1790100597.867030:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100597.867137:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:18e88987-66d0-4240-a27c-27ca03f877ad+5:13856:x1877056109521792:12345-192.168.201.18@tcp:13:lfs.0 Request processed in 149us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.867145:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00080000:3.0:1790100597.867230:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100597.872332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100597.876247:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109521920 00000100:00100000:2.0:1790100597.876265:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109521920 00000100:00100000:2.0:1790100597.876364:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1790100597.876376:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:18e88987-66d0-4240-a27c-27ca03f877ad+6:13856:x1877056109521920:12345-192.168.201.18@tcp:13:lfs.0 00002000:00000024:2.0:1790100597.876418:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100597.876538:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:18e88987-66d0-4240-a27c-27ca03f877ad+6:13856:x1877056109521920:12345-192.168.201.18@tcp:13:lfs.0 Request processed in 164us (4216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100597.876546:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00080000:0.0:1790100597.877766:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790100598.118243:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100598.219054:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100598.224080:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109522048 00000100:00100000:3.0:1790100598.224096:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109522048 00000100:00100000:3.0:1790100598.224267:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:3.0:1790100598.224279:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+10:13890:x1877056109522048:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790100598.224314:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100598.224333:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefe2ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc6502a expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100598.224374:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefe2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6502a expref: 11 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100598.224386:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67c21ff400/0x31a8f3fdeeefe2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6502a expref: 11 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100598.224395:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21ff400, rc 0) 00000100:00100000:3.0:1790100598.224506:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13890:x1877056109522048:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 198us (5431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100598.224514:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 92 00000100:00100000:2.0:1790100598.236271:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100598.236492:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109522176 00000100:00100000:3.0:1790100598.236503:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109522176 00000100:00100000:3.0:1790100598.236555:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:3.0:1790100598.236566:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13890:x1877056109522176:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790100598.243144:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13890:x1877056109522176:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 6570us (6875us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100598.243158:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 93 00000100:00100000:0.0:1790100598.253754:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100598.253947:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109522304 00000100:00100000:3.0:1790100598.254039:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109522304 00000100:00100000:3.0:1790100598.254160:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:3.0:1790100598.254172:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13890:x1877056109522304:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790100598.254436:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13890:x1877056109522304:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 264us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100598.254444:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 94 00000100:00100000:1.0:1790100598.268958:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100598.269501:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109522432 00000100:00100000:0.0:1790100598.269513:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109522432 00000100:00100000:0.0:1790100598.269582:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:0.0:1790100598.269593:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13895:x1877056109522432:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790100598.271661:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783503450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13895:x1877056109522432:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 759us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100598.271676:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 95 00000100:00100000:0.0:1790100598.319044:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100598.323055:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109522560 00000100:00100000:3.0:1790100598.323100:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109522560 00000100:00100000:1.0:1790100598.331835:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:1.0:1790100598.331857:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13895:x1877056109522560:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790100598.332178:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13895:x1877056109522560:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 328us (13223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100598.332187:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 96 00000100:00100000:1.0:1790100598.341526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100598.341895:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109522688 00000100:00100000:2.0:1790100598.341908:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109522688 00000100:00100000:2.0:1790100598.342075:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:2.0:1790100598.342086:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13890:x1877056109522688:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100598.342123:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100598.342146:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6785143a00/0x31a8f3fdeeefe2d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65054 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.342182:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6785143a00/0x31a8f3fdeeefe2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65054 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.342195:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6785143a00/0x31a8f3fdeeefe2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65054 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.342204:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143a00, rc 0) 00000100:00100000:2.0:1790100598.342282:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13890:x1877056109522688:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 197us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.342289:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 97 00000100:00100000:2.0:1790100598.355506:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100598.355606:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109522816 00000100:00100000:1.0:1790100598.355809:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109522816 00000100:00100000:1.0:1790100598.355870:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:1.0:1790100598.355882:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13890:x1877056109522816:12345-192.168.201.18@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790100598.356506:0:14375:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790100598.356535:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790100598.356539:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790100598.356543:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790100598.356545:0:14375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790100598.368174:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783503050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13890:x1877056109522816:12345-192.168.201.18@tcp:256:mount.lustre.0 Request processed in 12281us (12665us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100598.368190:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 98 00000100:00100000:0.0:1790100598.393409:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100598.394757:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109522944 00000100:00100000:2.0:1790100598.394770:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109522944 00000100:00100000:2.0:1790100598.394841:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:2.0:1790100598.394852:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13890:x1877056109522944:12345-192.168.201.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790100598.394868:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100598.395313:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc6505b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.395345:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6505b expref: 13 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.395356:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6505b expref: 13 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.395394:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143800, rc 0) 00000100:00100000:2.0:1790100598.395457:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13890:x1877056109522944:12345-192.168.201.18@tcp:101:mount.lustre.0 Request processed in 606us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.395465:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 99 00000100:00100000:2.0:1790100598.402025:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100598.402130:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109523072 00000100:00100000:0.0:1790100598.402141:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109523072 00000100:00100000:0.0:1790100598.402239:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:0.0:1790100598.402250:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13890:x1877056109523072:12345-192.168.201.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790100598.403072:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13890:x1877056109523072:12345-192.168.201.18@tcp:501:mount.lustre.0 Request processed in 820us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100598.403081:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 100 00000100:00100000:1.0:1790100598.410986:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100598.415458:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109523200 00000100:00100000:2.0:1790100598.415482:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109523200 00000100:00100000:2.0:1790100598.415534:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:2.0:1790100598.415543:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6783502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13890:x1877056109523200:12345-192.168.201.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790100598.415828:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6783502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13890:x1877056109523200:12345-192.168.201.18@tcp:503:mount.lustre.0 Request processed in 285us (4856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.415836:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 101 00000100:00100000:1.0:1790100598.425124:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100598.425246:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109523328 00000100:00100000:2.0:1790100598.425257:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109523328 00000100:00100000:2.0:1790100598.426188:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:2.0:1790100598.426200:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13899:x1877056109523328:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790100598.427008:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13899:x1877056109523328:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 802us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.427020:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 102 00000100:00100000:1.0:1790100598.431001:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100598.431147:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109523456 00000100:00100000:3.0:1790100598.431157:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109523456 00000100:00100000:3.0:1790100598.431217:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:3.0:1790100598.431227:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13899:x1877056109523456:12345-192.168.201.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790100598.431488:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13899:x1877056109523456:12345-192.168.201.18@tcp:502:llog_process_th.0 Request processed in 261us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100598.431497:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 103 00000100:00100000:1.0:1790100598.437435:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100598.437522:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100598.437555:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100598.437626:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109523968 00000100:00100000:0.0:1790100598.437637:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109523968 00000100:00100000:0.0:1790100598.437714:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:0.0:1790100598.437749:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+7:2359:x1877056109523968:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100598.437828:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+7:2359:x1877056109523968:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 90us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100598.437836:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1790100598.443179:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109524096 00000100:00100000:3.0:1790100598.443195:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109524096 00000100:00100000:3.0:1790100598.443260:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109524224 00000100:00100000:3.0:1790100598.443263:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109524224 00000100:00100000:3.0:1790100598.443286:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1790100598.443296:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+5:2359:x1877056109524096:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100598.443381:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+5:2359:x1877056109524096:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 86us (5954us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100598.443388:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1790100598.443405:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:3.0:1790100598.443411:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+6:2359:x1877056109524224:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100598.443433:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+6:2359:x1877056109524224:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 22us (5877us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100598.443438:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1790100598.451503:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100598.451637:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109523584 00000100:00100000:1.0:1790100598.451647:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109523584 00000100:00100000:1.0:1790100598.451694:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1790100598.451702:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1877056109523584:12345-192.168.201.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790100598.452017:0:14382:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5745a62d-b161-4567-a7f5-21880928c2da@192.168.201.18@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:1.0:1790100598.452072:0:14382:0:(genops.c:1384:class_connect()) connect: client 5745a62d-b161-4567-a7f5-21880928c2da, cookie 0x31a8f3fdeeefe2e3 00000004:00100000:1.0:1790100598.452104:0:14382:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790100598.452232:0:14382:0:(import.c:65:import_set_state_nolock()) ffff8d67bbb81000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790100598.452313:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5745a62d-b161-4567-a7f5-21880928c2da+6:2356:x1877056109523584:12345-192.168.201.18@tcp:38:mount.lustre.0 Request processed in 611us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100598.452321:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:1.0:1790100598.460859:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100598.460977:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100598.467984:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109523840 00000100:00100000:2.0:1790100598.468004:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109523840 00000100:00100000:2.0:1790100598.468203:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109523712 00000100:00100000:2.0:1790100598.468208:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109523712 00000100:00080000:3.0:1790100598.468264:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100598.469733:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1790100598.469764:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5745a62d-b161-4567-a7f5-21880928c2da+7:13890:x1877056109523840:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790100598.469816:0:14383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790100598.470123:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5745a62d-b161-4567-a7f5-21880928c2da+7:13890:x1877056109523840:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 369us (9271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100598.470131:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:0.0:1790100598.470155:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1790100598.470163:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5745a62d-b161-4567-a7f5-21880928c2da+6:0:x1877056109523712:12345-192.168.201.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790100598.470176:0:14383:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790100598.470200:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5745a62d-b161-4567-a7f5-21880928c2da+6:0:x1877056109523712:12345-192.168.201.18@tcp:41:mount.lustre.0 Request processed in 39us (9223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100598.470206:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:0.0:1790100598.481273:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100598.481506:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109524352 00000100:00100000:2.0:1790100598.481520:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109524352 00000100:00100000:2.0:1790100598.481646:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1790100598.481658:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+6:13890:x1877056109524352:12345-192.168.201.18@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790100598.481823:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+6:13890:x1877056109524352:12345-192.168.201.18@tcp:40:mount.lustre.0 Request processed in 167us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.481831:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1790100598.493588:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100598.494445:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100598.494492:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100598.495151:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109524480 00000100:00100000:2.0:1790100598.495172:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109524480 00000100:00100000:2.0:1790100598.495227:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109524608 00000100:00100000:2.0:1790100598.495231:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109524608 00000100:00100000:2.0:1790100598.495248:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:2.0:1790100598.495257:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1877056109524480:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790100598.495292:0:15063:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5745a62d-b161-4567-a7f5-21880928c2da@192.168.201.18@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1790100598.495323:0:15063:0:(genops.c:1384:class_connect()) connect: client 5745a62d-b161-4567-a7f5-21880928c2da, cookie 0x31a8f3fdeeefe2ea 00002000:00100000:2.0:1790100598.495337:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5745a62d-b161-4567-a7f5-21880928c2da/ffff8d67ad05f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790100598.495349:0:15063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790100598.495640:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790100598.495675:0:15063:0:(import.c:65:import_set_state_nolock()) ffff8d67ad059000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100598.495752:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5745a62d-b161-4567-a7f5-21880928c2da+6:2356:x1877056109524480:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 483us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.495761:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:2.0:1790100598.495780:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:2.0:1790100598.495785:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1877056109524608:12345-192.168.201.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790100598.495801:0:15063:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5745a62d-b161-4567-a7f5-21880928c2da@192.168.201.18@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1790100598.495841:0:15063:0:(genops.c:1384:class_connect()) connect: client 5745a62d-b161-4567-a7f5-21880928c2da, cookie 0x31a8f3fdeeefe2f1 00002000:00100000:2.0:1790100598.495847:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5745a62d-b161-4567-a7f5-21880928c2da/ffff8d67852fe800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790100598.495858:0:15063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790100598.496061:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790100598.496077:0:15063:0:(import.c:65:import_set_state_nolock()) ffff8d67852ff000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790100598.496102:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5745a62d-b161-4567-a7f5-21880928c2da+6:2356:x1877056109524608:12345-192.168.201.18@tcp:8:mount.lustre.0 Request processed in 315us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.496110:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1790100598.498997:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109524736 00000100:00100000:1.0:1790100598.499014:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109524736 00000100:00100000:1.0:1790100598.499081:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:1.0:1790100598.499092:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5745a62d-b161-4567-a7f5-21880928c2da+6:13890:x1877056109524736:12345-192.168.201.18@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790100598.499184:0:14385:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790100598.499996:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5745a62d-b161-4567-a7f5-21880928c2da+6:13890:x1877056109524736:12345-192.168.201.18@tcp:33:mount.lustre.0 Request processed in 901us (6413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100598.500007:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:1.0:1790100598.503073:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67b5a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126288512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100598.503145:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100598.503252:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126288640:0@lo:400:kworker.0 00000100:00100000:0.0:1790100598.503299:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100598.503345:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126289152:0@lo:400:kworker.0 00000100:00100000:0.0:1790100598.503369:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100598.503393:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790100598.503399:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126288768:0@lo:400:kworker.0 00000100:00100000:0.0:1790100598.503441:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100598.503458:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126289280:0@lo:400:kworker.0 00000100:00100000:0.0:1790100598.503495:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100598.504076:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126289152 00000100:00100000:0.0:1790100598.504084:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126289152 00000100:00100000:3.0:1790100598.504637:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126288768 00000100:00100000:3.0:1790100598.504643:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126288768 00000100:00100000:3.0:1790100598.504693:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100598.505237:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126288768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100598.505326:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126288768:12345-0@lo:400:kworker.0 Request processed in 625us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100598.505335:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100598.505368:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126288640 00000100:00100000:3.0:1790100598.505373:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126288640 00000100:00100000:3.0:1790100598.505399:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790100598.505405:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3313:x1877056126288640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100598.505435:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3313:x1877056126288640:12345-0@lo:400:kworker.0 Request processed in 30us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100598.505440:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790100598.506090:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126289280 00000100:00100000:0.0:1790100598.506096:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126289280 00000100:00100000:1.0:1790100598.506198:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126289024:0@lo:400:kworker.0 00000100:00100000:1.0:1790100598.506248:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100598.506322:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126288896:0@lo:400:kworker.0 00000100:00100000:3.0:1790100598.506357:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100598.506399:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126288512 00000100:00100000:3.0:1790100598.506403:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126288512 00000100:00100000:3.0:1790100598.506433:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790100598.506441:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126288512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100598.506462:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100598.506522:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126288512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100598.506530:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100598.507468:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67b5a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126288512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790100598.507585:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126289024 00000100:00100000:2.0:1790100598.507592:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126289024 00000100:00100000:2.0:1790100598.507647:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790100598.507655:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126289152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100598.507724:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1877056126289152:12345-0@lo:400:kworker.0 Request processed in 68us (4352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.507731:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790100598.508422:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100598.508432:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126289280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100598.508480:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126289280:12345-0@lo:400:kworker.0 Request processed in 41us (4974us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.508487:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790100598.508500:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790100598.508506:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126289024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100598.508550:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1877056126289024:12345-0@lo:400:kworker.0 Request processed in 44us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.508556:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1790100598.508640:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100598.508646:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100598.508650:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790100598.508780:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1877056126289024:0@lo:400:kworker.0 00000100:00100000:1.0:1790100598.509150:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126288768:0@lo:400:kworker.0 00000100:00100000:1.0:1790100598.509179:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126289280:0@lo:400:kworker.0 00000100:00100000:1.0:1790100598.509198:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126288640:0@lo:400:kworker.0 00000100:00100000:1.0:1790100598.509209:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1877056126289152:0@lo:400:kworker.0 00000100:00100000:0.0:1790100598.509431:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126288896 00000100:00100000:0.0:1790100598.509438:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126288896 00000100:00100000:0.0:1790100598.509489:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790100598.509498:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126288896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100598.509557:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126288896:12345-0@lo:400:kworker.0 Request processed in 60us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100598.509564:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790100598.509985:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126288896:0@lo:400:kworker.0 00000100:00100000:3.0:1790100598.920764:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100598.920928:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109524864 00000100:00100000:2.0:1790100598.920940:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109524864 00000100:00100000:2.0:1790100598.921048:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:2.0:1790100598.921060:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+6:13920:x1877056109524864:12345-192.168.201.18@tcp:101:mkdir.0 00010000:00010000:2.0:1790100598.921080:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100598.921101:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefe2f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65085 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.921177:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.921192:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.921206:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100598.922154:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790100598.922162:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100598.922188:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.922220:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefe2f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65085 expref: 8 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.924390:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65085 expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100598.924407:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787defd00) 00010000:00010000:2.0:1790100598.924410:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100598.924432:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143c00, rc 0) 00000100:00100000:2.0:1790100598.924539:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+7:13920:x1877056109524864:12345-192.168.201.18@tcp:101:mkdir.0 Request processed in 3479us (3782us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100598.924549:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000001:00100000:1.0:1790100599.102175:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5745a62d-b161-4567-a7f5-21880928c2da 00000001:00100000:1.0:1790100599.102193:0:7647:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 18e88987-66d0-4240-a27c-27ca03f877ad 00010000:00010000:2.0:1790100599.146195:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100600.167326:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790100600.642175:0:5863:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5745a62d-b161-4567-a7f5-21880928c2da 00000001:00100000:1.0:1790100600.642192:0:5863:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 18e88987-66d0-4240-a27c-27ca03f877ad 00000100:00100000:1.0:1790100601.063300:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126289408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790100601.063381:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100601.063541:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126289408 00000100:00100000:2.0:1790100601.063551:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126289408 00000100:00100000:2.0:1790100601.063638:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100601.063648:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126289408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100601.063695:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100601.063743:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877056126289408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100601.063750:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790100601.063797:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1877056126289408:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790100601.063974:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790100601.190371:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790100602.216476:0:6714:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5745a62d-b161-4567-a7f5-21880928c2da 00010000:00010000:2.0:1790100602.216539:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790100602.627300:0:16347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:3.0:1790100602.664572:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790100603.237891:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100603.621863:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126289920:0@lo:400:kworker.0 00000100:00100000:3.0:1790100603.621885:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126289536:0@lo:400:kworker.0 00000100:00100000:2.0:1790100603.622006:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126289664:0@lo:400:kworker.0 00000100:00100000:1.0:1790100603.626765:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100603.626876:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126289792:0@lo:400:kworker.0 00000100:00100000:1.0:1790100603.626937:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100603.626965:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126290304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100603.626986:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100603.627020:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126289792 00000100:00100000:1.0:1790100603.627028:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126289792 00000100:00100000:1.0:1790100603.627091:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100603.627101:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126289792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100603.627154:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126289792:12345-0@lo:400:kworker.0 Request processed in 55us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100603.627169:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790100603.627192:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126290304 00000100:00100000:1.0:1790100603.627195:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126290304 00000100:00100000:1.0:1790100603.627219:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790100603.627226:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126290304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790100603.627253:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790100603.627293:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126290304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100603.627299:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1790100603.627314:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790100603.627361:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126289792:0@lo:400:kworker.0 00000100:00100000:1.0:1790100603.627378:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126290304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790100603.627450:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126289920 00000100:00100000:1.0:1790100603.627454:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126289920 00000100:00100000:1.0:1790100603.627483:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790100603.627489:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126289920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100603.627527:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877056126289920:12345-0@lo:400:kworker.0 Request processed in 39us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100603.627533:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790100603.627564:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877056126289920:0@lo:400:kworker.0 00000100:00100000:3.0:1790100603.630658:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100603.630736:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126289536 00000100:00100000:3.0:1790100603.630738:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126290048:0@lo:400:kworker.0 00000100:00100000:1.0:1790100603.630748:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126289536 00000100:00100000:3.0:1790100603.630807:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100603.630808:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790100603.630820:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3312:x1877056126289536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100603.630888:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3312:x1877056126289536:12345-0@lo:400:kworker.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100603.630889:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126290048 00000100:00100000:3.0:1790100603.630895:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126290048 00000100:00100000:1.0:1790100603.630909:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790100603.630959:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790100603.630968:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126290048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100603.631010:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126290048:12345-0@lo:400:kworker.0 Request processed in 45us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100603.631017:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1790100603.631035:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100603.631064:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126289536:0@lo:400:kworker.0 00000100:00100000:3.0:1790100603.631078:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126290048:0@lo:400:kworker.0 00000100:00100000:2.0:1790100603.639284:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100603.639343:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126290176:0@lo:400:kworker.0 00000100:00100000:2.0:1790100603.639376:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100603.639429:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126290176 00000100:00100000:1.0:1790100603.639439:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126290176 00000100:00100000:1.0:1790100603.639519:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790100603.639532:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126290176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100603.639607:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1877056126290176:12345-0@lo:400:kworker.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100603.639633:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1790100603.639772:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790100603.639804:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1877056126290176:0@lo:400:kworker.0 00000100:00100000:0.0:1790100603.640512:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126289664 00000100:00100000:0.0:1790100603.640519:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126289664 00000100:00100000:0.0:1790100603.640568:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790100603.640577:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126289664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100603.640656:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126289664:12345-0@lo:400:kworker.0 Request processed in 81us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100603.640663:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790100603.640701:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126289664:0@lo:400:kworker.0 00000100:00080000:2.0:1790100603.640764:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100603.949796:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100603.949839:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100603.949859:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100603.949881:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100603.949898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100603.949913:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100603.949936:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100603.949962:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109525504 00000100:00100000:3.0:1790100603.949972:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109525504 00000100:00100000:3.0:1790100603.950034:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109525120 00000100:00100000:3.0:1790100603.950037:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109525120 00000100:00100000:3.0:1790100603.950056:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:3.0:1790100603.950064:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5745a62d-b161-4567-a7f5-21880928c2da+6:2359:x1877056109525504:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100603.950184:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5745a62d-b161-4567-a7f5-21880928c2da+6:2359:x1877056109525504:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 111us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100603.950191:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:3.0:1790100603.950209:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:3.0:1790100603.950226:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+6:2359:x1877056109525120:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100603.950254:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+6:2359:x1877056109525120:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100603.950260:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:3.0:1790100603.950279:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109525248 00000100:00100000:3.0:1790100603.950282:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109525248 00000100:00100000:1.0:1790100603.950395:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109525760 00000100:00100000:1.0:1790100603.950400:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109525760 00000100:00100000:1.0:1790100603.950425:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109525376 00000100:00100000:1.0:1790100603.950429:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109525376 00000100:00100000:1.0:1790100603.950439:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109525632 00000100:00100000:1.0:1790100603.950442:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109525632 00000100:00100000:3.0:1790100603.950479:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1790100603.950484:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5745a62d-b161-4567-a7f5-21880928c2da+5:2359:x1877056109525760:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100603.950512:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5745a62d-b161-4567-a7f5-21880928c2da+5:2359:x1877056109525760:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100603.950518:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1790100603.950530:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1790100603.950536:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e88987-66d0-4240-a27c-27ca03f877ad+5:2359:x1877056109525376:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100603.950558:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e88987-66d0-4240-a27c-27ca03f877ad+5:2359:x1877056109525376:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 22us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100603.950563:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:3.0:1790100603.950575:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1790100603.950749:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109524992 00000100:00100000:0.0:1790100603.950754:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109524992 00000100:00100000:0.0:1790100603.950787:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:0.0:1790100603.950795:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:2359:x1877056109524992:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100603.950824:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:2359:x1877056109524992:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 30us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100603.950841:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 106 00000100:00100000:1.0:1790100603.951414:0:15064:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790100603.951424:0:15064:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1790100603.951895:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1790100603.951908:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5745a62d-b161-4567-a7f5-21880928c2da+5:2359:x1877056109525632:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:0.0:1790100603.951955:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5745a62d-b161-4567-a7f5-21880928c2da+5:2359:x1877056109525632:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 51us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100603.951961:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00080000:2.0:1790100603.952679:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100603.952686:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790100603.952846:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790100603.953728:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e88987-66d0-4240-a27c-27ca03f877ad+5:2359:x1877056109525248:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100603.953804:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e88987-66d0-4240-a27c-27ca03f877ad+5:2359:x1877056109525248:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 3222us (3963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100603.953823:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00010000:00010000:2.0:1790100604.280036:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100605.285913:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100606.182457:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790100606.182525:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126290432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790100606.185437:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100606.185525:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126290432 00000100:00100000:2.0:1790100606.185535:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126290432 00000100:00100000:2.0:1790100606.185684:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790100606.185695:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126290432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100606.185732:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100606.185795:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126290432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100606.185802:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790100606.185824:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100606.185889:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126290432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790100606.309835:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790100606.863084:0:16495:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff20e244a0 20000000:00000080:1.0:1790100606.863105:0:16495:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d6682b7dc00 uarg=0000000000000000 20000000:01000000:1.0:1790100606.863198:0:16495:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790100606.863204:0:16495:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790100606.863209:0:16495:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1790100606.867728:0:16496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1790100606.867954:0:16495:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790100606.882787:0:16495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790100606.882819:0:16495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.882839:0:16495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefdff6 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.882847:0:16495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe043 expref: 18 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.882855:0:16495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe17e expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.882866:0:16495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff9 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.882895:0:16495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6505b expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.882903:0:16495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.882953:0:16495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6505b expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.882969:0:16495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6505b expref: 12 pid: 14374 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.882986:0:16495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126290560:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100606.883152:0:16495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff9 expref: 12 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.883161:0:16495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff9 expref: 12 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.883169:0:16495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126290688:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100606.883200:0:16495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefe17e expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.883281:0:16495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe17e expref: 18 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.883291:0:16495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126290816:0@lo:104: 00000100:00100000:2.0:1790100606.883346:0:16495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790100606.888649:0:16495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefe043 expref: 18 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.888670:0:16495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe043 expref: 18 pid: 14375 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.888687:0:16495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126290944:0@lo:104: 00000100:00100000:2.0:1790100606.888767:0:16495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100606.895247:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100606.895365:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100606.895425:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109525888 00000100:00100000:3.0:1790100606.895435:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109525888 00010000:00010000:3.0:1790100606.895482:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6505b expref: 13 pid: 14374 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100606.895514:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109526016 00000100:00100000:3.0:1790100606.895518:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109526016 00010000:00010000:3.0:1790100606.895530:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff9 expref: 14 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100606.895545:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1790100606.895553:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+14:2357:x1877056109525888:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100606.895573:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100606.895579:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6505b expref: 14 pid: 14374 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.895591:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6505b expref: 14 pid: 14374 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.895631:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100606.895681:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+14:2357:x1877056109525888:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 128us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100606.895687:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:3.0:1790100606.895721:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1790100606.895728:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:2358:x1877056109526016:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100606.895736:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100606.895740:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff9 expref: 13 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.895747:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff9 expref: 13 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.895757:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100606.895774:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:2358:x1877056109526016:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100606.895781:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00010000:00010000:2.0:1790100606.896683:0:16495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x31a8f3fdeeefdff6 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.896696:0:16495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdff6 expref: 18 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.896710:0:16495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126291072:0@lo:104: 00000100:00100000:2.0:1790100606.896758:0:16495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100606.896935:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126290816 00000100:00100000:0.0:1790100606.896944:0:14365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126290816 00000100:00100000:0.0:1790100606.896981:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126290944 00000100:00100000:0.0:1790100606.896985:0:14365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126290944 00000100:00100000:0.0:1790100606.896999:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100606.897007:0:14365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+4:16495:x1877056126290816:12345-0@lo:104: 00010000:00010000:0.0:1790100606.897020:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.897081:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790100606.897087:0:14365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+4:16495:x1877056126290816:12345-0@lo:104: Request processed in 81us (13742us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100606.897093:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790100606.897109:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790100606.897115:0:14365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:16495:x1877056126290944:12345-0@lo:104: 00010000:00010000:0.0:1790100606.897123:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.897197:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790100606.897202:0:14365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:16495:x1877056126290944:12345-0@lo:104: Request processed in 88us (8436us total) trans 0 rc 0/0 00010000:00010000:3.0:1790100606.897292:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790100606.897299:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897306:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1790100606.897311:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897319:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100606.897337:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100606.897344:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100606.897375:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897393:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100606.897414:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897421:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67ad818400/0x31a8f3fdeeefe17e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefe185 expref: -99 pid: 15780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897434:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100606.897438:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897444:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819e00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1790100606.897447:0:14370:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897467:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790100606.897474:0:14370:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100606.897480:0:14370:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790100606.897493:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897500:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790100606.897515:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897522:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67ad819e00/0x31a8f3fdeeefe043 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefe04a expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897538:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100606.897539:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100606.897541:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100606.897548:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790100606.897582:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126291200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100606.897636:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100606.897677:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790100606.897685:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3314:1877056126291328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100606.897711:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100606.897737:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126291200 00000100:00100000:3.0:1790100606.897742:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126291200 00010000:00010000:3.0:1790100606.897762:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe17e expref: 19 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100606.897783:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126291328 00000100:00100000:3.0:1790100606.897786:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126291328 00010000:00010000:3.0:1790100606.897796:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe043 expref: 20 pid: 14375 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100606.897807:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790100606.897813:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bc813850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+20:3312:x1877056126291200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100606.897823:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100606.897827:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe17e expref: 20 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897837:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe17e expref: 20 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897864:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100606.897896:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bc813850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+20:3312:x1877056126291200:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100606.897903:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790100606.897941:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100606.897948:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3314:x1877056126291328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100606.897955:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100606.897960:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe043 expref: 19 pid: 14375 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897968:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefe043 expref: 19 pid: 14375 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.897977:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100606.898001:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3314:x1877056126291328:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100606.898007:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790100606.898041:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3314:1877056126291328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790100606.898068:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126291200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790100606.898344:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790100606.901751:0:14365:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790100606.901779:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126291072 00000100:00100000:3.0:1790100606.901789:0:14365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126291072 00000100:00100000:3.0:1790100606.901835:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790100606.901847:0:14365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d679e065c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:16495:x1877056126291072:12345-0@lo:104: 00010000:00010000:3.0:1790100606.901864:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100606.901954:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790100606.901961:0:14365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d679e065c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+3:16495:x1877056126291072:12345-0@lo:104: Request processed in 118us (5203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100606.901968:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1790100606.906253:0:14371:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790100606.906268:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100606.906279:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67900ae400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1790100606.906283:0:14371:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100606.906313:0:14371:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790100606.906321:0:14371:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790100606.906337:0:14371:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790100606.906464:0:14371:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100606.906471:0:14371:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790100606.906497:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100606.906504:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.118@tcp lock: ffff8d67900ae400/0x31a8f3fdeeefdff6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x31a8f3fdeeefdffd expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100606.906523:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100606.906525:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100606.906527:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100606.906534:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100606.906551:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6785129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126291456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790100606.906843:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100606.907324:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126291456 00000100:00100000:0.0:1790100606.907344:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126291456 00010000:00010000:0.0:1790100606.907380:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdff6 expref: 19 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.907466:0:16495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6787a20f00 going to sleep for 11 seconds 00010000:00010000:2.0:1790100606.907498:0:16495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6785143800/0x31a8f3fdeeefe2dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6505b expref: 12 pid: 14374 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.907511:0:16495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126290560:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100606.907523:0:16495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67c21ff000/0x31a8f3fdeeefe2a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc64ff9 expref: 11 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.907532:0:16495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126290688:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100606.907542:0:16495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6785143e00/0x31a8f3fdeeefe185 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefe17e expref: 19 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.907549:0:16495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126290816:0@lo:104: 00010000:00010000:2.0:1790100606.907587:0:16495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67b5e13800/0x31a8f3fdeeefe04a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefe043 expref: 18 pid: 14375 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100606.907596:0:16495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126290944:0@lo:104: 00000100:00100000:2.0:1790100606.907604:0:16495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16495:1877056126291072:0@lo:104: 00010000:00010000:2.0:1790100606.907644:0:16495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100606.908082:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790100606.908094:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:3313:x1877056126291456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790100606.908112:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100606.908119:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdff6 expref: 17 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908131:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x31a8f3fdeeefdff6 expref: 17 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908148:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefdffd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x31a8f3fdeeefdff6 expref: 17 pid: 14376 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908162:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908171:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908185:0:14367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908192:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908222:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908229:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908234:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142800 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100606.908238:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908245:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908261:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100606.908270:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100606.908317:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3313:x1877056126291456:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100606.908324:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1790100606.908522:0:16495:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.908531:0:16495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100606.908537:0:16495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6785142800/0x31a8f3fdeeefe306 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100606.910226:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6785129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3313:1877056126291456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790100607.333959:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100608.244975:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100608.245045:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109526144 00000100:00100000:1.0:1790100608.245057:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109526144 00000100:00100000:1.0:1790100608.245113:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:1.0:1790100608.245123:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+11:13774:x1877056109526144:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100608.245141:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100608.245173:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67b5e12600/0x31a8f3fdeeefe30d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc6508c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.245202:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67b5e12600/0x31a8f3fdeeefe30d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6508c expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.245214:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67b5e12600/0x31a8f3fdeeefe30d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6508c expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.245223:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12600, rc 0) 00000100:00100000:1.0:1790100608.245280:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13774:x1877056109526144:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100608.245287:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 107 00000100:00100000:0.0:1790100608.264103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100608.264191:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109526272 00000100:00100000:2.0:1790100608.264205:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109526272 00000100:00100000:2.0:1790100608.264274:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 108 00000100:00100000:2.0:1790100608.264287:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13774:x1877056109526272:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790100608.264646:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13774:x1877056109526272:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 360us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.264654:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 108 00000100:00100000:3.0:1790100608.269281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100608.270400:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109526400 00000100:00100000:1.0:1790100608.270416:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109526400 00000100:00100000:1.0:1790100608.270489:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 109 00000100:00100000:1.0:1790100608.270499:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13774:x1877056109526400:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100608.270763:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13774:x1877056109526400:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 264us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100608.270772:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 109 00000100:00100000:1.0:1790100608.288235:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100608.288322:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109526528 00000100:00100000:3.0:1790100608.288333:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109526528 00000100:00100000:3.0:1790100608.288393:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 110 00000100:00100000:3.0:1790100608.288403:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+12:13774:x1877056109526528:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100608.288422:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100608.288440:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67c21ff600/0x31a8f3fdeeefe314 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65093 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.288470:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67c21ff600/0x31a8f3fdeeefe314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65093 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.288481:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67c21ff600/0x31a8f3fdeeefe314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65093 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.288491:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21ff600, rc 0) 00000100:00100000:3.0:1790100608.288677:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13774:x1877056109526528:12345-192.168.201.18@tcp:101:ll_cfg_requeue.0 Request processed in 145us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.288686:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 110 00000100:00100000:3.0:1790100608.290992:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100608.291032:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109526656 00000100:00100000:3.0:1790100608.291042:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109526656 00000100:00100000:3.0:1790100608.291102:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:3.0:1790100608.291112:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13774:x1877056109526656:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100608.291469:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13774:x1877056109526656:12345-192.168.201.18@tcp:501:ll_cfg_requeue.0 Request processed in 357us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.291478:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 111 00000100:00100000:3.0:1790100608.295991:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100608.296088:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109526784 00000100:00100000:2.0:1790100608.296099:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109526784 00000100:00100000:2.0:1790100608.296152:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 112 00000100:00100000:2.0:1790100608.296161:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13774:x1877056109526784:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100608.296448:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:13774:x1877056109526784:12345-192.168.201.18@tcp:503:ll_cfg_requeue.0 Request processed in 278us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.296457:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 112 00010000:00010000:0.0:1790100608.357808:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100608.742748:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100608.742775:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126291584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100608.742856:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100608.743083:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126291584 00000100:00100000:2.0:1790100608.743092:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126291584 00000100:00100000:2.0:1790100608.743165:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790100608.743176:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126291584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790100608.743214:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100608.743265:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126291584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.743273:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1790100608.743334:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100608.743410:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126291584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790100608.744202:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126291840:0@lo:400:kworker.0 00000100:00100000:3.0:1790100608.744247:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100608.744275:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790100608.744281:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126291968:0@lo:400:kworker.0 00000100:00100000:3.0:1790100608.744315:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100608.744347:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126291840 00000100:00100000:3.0:1790100608.744353:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126291840 00000100:00100000:3.0:1790100608.744399:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790100608.744410:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126291840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.744541:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126292096:0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.744572:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100608.744592:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790100608.744597:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3311:1877056126291712:0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.744643:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100608.744668:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126292224:0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.744707:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100608.744733:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126291968 00000100:00100000:1.0:1790100608.744738:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126291968 00000100:00100000:1.0:1790100608.744760:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126292096 00000100:00100000:1.0:1790100608.744763:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126292096 00000100:00100000:1.0:1790100608.744776:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126292224 00000100:00100000:1.0:1790100608.744779:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126292224 00000100:00100000:1.0:1790100608.744793:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790100608.744800:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.744849:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126291968:12345-0@lo:400:kworker.0 Request processed in 49us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100608.744857:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790100608.744875:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790100608.744881:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126292096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.744928:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877056126292096:12345-0@lo:400:kworker.0 Request processed in 47us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100608.744934:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790100608.744947:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790100608.744953:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126292224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.744978:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877056126292224:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100608.744984:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790100608.745002:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126291712 00000100:00100000:1.0:1790100608.745006:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126291712 00000100:00100000:1.0:1790100608.745034:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790100608.745041:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3311:x1877056126291712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.745070:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:3311:x1877056126291712:12345-0@lo:400:kworker.0 Request processed in 30us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100608.745084:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790100608.745137:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3311:1877056126291712:0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.745151:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1877056126292224:0@lo:400:kworker.0 00000100:00100000:1.0:1790100608.745160:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1877056126292096:0@lo:400:kworker.0 00000100:00100000:3.0:1790100608.745660:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126291840:12345-0@lo:400:kworker.0 Request processed in 1249us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.745670:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1790100608.745702:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790100608.745708:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100608.745731:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126291968:0@lo:400:kworker.0 00000100:00100000:3.0:1790100608.745742:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126291840:0@lo:400:kworker.0 10000000:01000000:3.0:1790100608.805748:0:14378:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790100608.805757:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67ad05d000 from 10 10000000:01000000:3.0:1790100608.805763:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100608.805825:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefe31b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.805837:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefe31b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.805849:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefe31b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.805878:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787771180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100608.805969:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100608.806027:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.806092:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126292352 00000100:00100000:0.0:1790100608.806100:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126292352 00000100:00100000:0.0:1790100608.806149:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790100608.806158:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+16:14378:x1877056126292352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100608.806171:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100608.806184:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad819400/0x31a8f3fdeeefe322 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe31b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.806205:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad819400/0x31a8f3fdeeefe322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe31b expref: 17 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.806214:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad819400/0x31a8f3fdeeefe322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe31b expref: 17 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.806223:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819400, rc 0) 00000100:00100000:0.0:1790100608.806273:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:14378:x1877056126292352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100608.806280:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790100608.806465:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787771180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100608.806480:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefe31b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe322 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.806488:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefe31b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe322 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.806553:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787771180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100608.806581:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100608.809345:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.815239:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126292480 00000100:00100000:0.0:1790100608.815255:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126292480 00000100:00100000:0.0:1790100608.815326:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1790100608.815337:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:14378:x1877056126292480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100608.815709:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:14378:x1877056126292480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (9126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100608.815717:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790100608.816183:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787771180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100608.816240:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100608.816289:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100608.816335:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e2600 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.816391:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126292608 00000100:00100000:0.0:1790100608.816397:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126292608 00000100:00100000:0.0:1790100608.816526:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790100608.816552:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf9a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:14378:x1877056126292608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790100608.816743:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf9a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:14378:x1877056126292608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100608.816751:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790100608.816860:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100608.818503:0:16565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790100608.819049:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790100608.819072:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100608.819082:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefe31b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe322 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.819094:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67c21fee00/0x31a8f3fdeeefe31b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe322 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100608.819123:0:14378:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790100608.819126:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d67a5ba5800 from 10 10000000:01000000:3.0:1790100608.819128:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100608.819167:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefe329 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.819174:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefe329 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.819185:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefe329 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.819207:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787773480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100608.819275:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100608.820087:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.820276:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126292736 00000100:00100000:0.0:1790100608.820286:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126292736 00000100:00100000:0.0:1790100608.820352:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790100608.820362:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+17:14378:x1877056126292736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100608.820375:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100608.820391:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefe330 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe329 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.820415:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefe330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe329 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.820425:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad818600/0x31a8f3fdeeefe330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe329 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.820433:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818600, rc 0) 00000100:00100000:0.0:1790100608.820526:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:14378:x1877056126292736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100608.820540:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1790100608.821406:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787773480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790100608.821431:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefe329 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe330 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100608.821443:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefe329 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe330 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100608.821521:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100608.821572:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100608.821645:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.821652:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126292864 00000100:00100000:0.0:1790100608.821657:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126292864 00000100:00100000:0.0:1790100608.821694:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790100608.821703:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:14378:x1877056126292864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100608.822167:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:14378:x1877056126292864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 461us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100608.822182:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1790100608.822349:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790100608.822381:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d678512b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790100608.822420:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100608.822447:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790100608.822701:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126292992 00000100:00100000:2.0:1790100608.822708:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126292992 00000100:00100000:2.0:1790100608.822754:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790100608.822762:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:14378:x1877056126292992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790100608.822943:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:14378:x1877056126292992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100608.822949:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790100608.823091:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d678512b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126292992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100608.824760:0:16566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790100608.824865:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790100608.824890:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100608.824915:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefe329 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe330 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.824926:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff800/0x31a8f3fdeeefe329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe330 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790100608.824936:0:14378:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790100608.824939:0:14378:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6682507800 from 10 10000000:01000000:3.0:1790100608.824942:0:14378:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790100608.824979:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff000/0x31a8f3fdeeefe337 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.825003:0:14378:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff000/0x31a8f3fdeeefe337 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.825013:0:14378:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff000/0x31a8f3fdeeefe337 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.825036:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787773b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126293120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790100608.825094:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100608.825141:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.825411:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126293120 00000100:00100000:0.0:1790100608.825421:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126293120 00000100:00100000:0.0:1790100608.825472:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1790100608.825482:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+18:14378:x1877056126293120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790100608.825496:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100608.825509:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefe33e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31a8f3fdeeefe337 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.825544:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefe33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe337 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.825554:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d67ad819e00/0x31a8f3fdeeefe33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x31a8f3fdeeefe337 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100608.825562:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819e00, rc 0) 00000100:00100000:0.0:1790100608.825642:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:14378:x1877056126293120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100608.825649:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1790100608.827292:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787773b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126293120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790100608.827329:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff000/0x31a8f3fdeeefe337 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe33e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.827342:0:14378:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff000/0x31a8f3fdeeefe337 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x31a8f3fdeeefe33e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100608.827429:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787773b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126293248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100608.827478:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100608.827517:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100608.827643:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126293248 00000100:00100000:0.0:1790100608.827650:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126293248 00000100:00100000:0.0:1790100608.827693:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790100608.827701:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:14378:x1877056126293248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790100608.828187:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:14378:x1877056126293248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 486us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100608.828196:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790100608.831234:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787773b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126293248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790100608.831321:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787773b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126293376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100608.831412:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100608.831463:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a97f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1790100608.831558:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126293376 00000100:00100000:2.0:1790100608.831566:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126293376 00000100:00100000:2.0:1790100608.831642:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1790100608.831652:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:14378:x1877056126293376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790100608.832264:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:14378:x1877056126293376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 612us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100608.832284:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1790100608.832379:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787773b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:14378:1877056126293376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790100608.833239:0:16567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790100608.833765:0:14378:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790100608.833788:0:14378:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790100608.833799:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff000/0x31a8f3fdeeefe337 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe33e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100608.833811:0:14378:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.118@tcp lock: ffff8d67c21ff000/0x31a8f3fdeeefe337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x31a8f3fdeeefe33e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100609.074598:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100609.074684:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100609.074710:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100609.074730:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100609.074751:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100609.074771:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100609.074798:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109527168 00000100:00100000:3.0:1790100609.074809:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109527168 00000100:00100000:3.0:1790100609.074861:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109527424 00000100:00100000:3.0:1790100609.074865:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109527424 00000100:00100000:3.0:1790100609.074877:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109527040 00000100:00100000:3.0:1790100609.074878:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109527040 00000100:00100000:3.0:1790100609.074904:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109527552 00000100:00100000:3.0:1790100609.074907:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109527552 00000100:00100000:3.0:1790100609.074926:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1790100609.074937:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+5:2360:x1877056109527168:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100609.075035:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+5:2360:x1877056109527168:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 98us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100609.075044:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1790100609.075082:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1790100609.075088:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5745a62d-b161-4567-a7f5-21880928c2da+5:2360:x1877056109527424:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100609.075115:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5745a62d-b161-4567-a7f5-21880928c2da+5:2360:x1877056109527424:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100609.075120:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1790100609.075130:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1790100609.075136:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+5:2360:x1877056109527040:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100609.075162:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+5:2360:x1877056109527040:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100609.075168:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:3.0:1790100609.075177:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:3.0:1790100609.075183:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5745a62d-b161-4567-a7f5-21880928c2da+5:2360:x1877056109527552:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100609.075202:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5745a62d-b161-4567-a7f5-21880928c2da+5:2360:x1877056109527552:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 20us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100609.075209:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:3.0:1790100609.075237:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109526912 00000100:00100000:3.0:1790100609.075241:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109526912 00000100:00100000:3.0:1790100609.075271:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109527296 00000100:00100000:3.0:1790100609.075273:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109527296 00000100:00100000:3.0:1790100609.075287:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:3.0:1790100609.075304:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+6:2360:x1877056109526912:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100609.075332:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+6:2360:x1877056109526912:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 40us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100609.075338:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:3.0:1790100609.075359:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:3.0:1790100609.075365:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5745a62d-b161-4567-a7f5-21880928c2da+6:2360:x1877056109527296:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100609.075388:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5745a62d-b161-4567-a7f5-21880928c2da+6:2360:x1877056109527296:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 23us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100609.075394:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00080000:3.0:1790100609.075414:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790100609.075420:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790100609.075422:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790100609.388071:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790100610.406042:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100611.019161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100611.019253:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109527680 00000100:00100000:3.0:1790100611.019275:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109527680 00000100:00100000:3.0:1790100611.019359:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1790100611.019371:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+6:14431:x1877056109527680:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100611.019392:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100611.019414:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fea00/0x31a8f3fdeeefe345 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc6509a expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790100611.019595:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790100611.019742:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.019758:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.019773:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.019788:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.019795:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.019808:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020122:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ff200/0x31a8f3fdeeefe35a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020131:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ff200/0x31a8f3fdeeefe35a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020139:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ff200/0x31a8f3fdeeefe35a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100611.020164:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790100611.020167:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100611.020202:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ff200/0x31a8f3fdeeefe35a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020214:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020219:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020226:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020231:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fec00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100611.020235:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020242:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020275:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787defd00) 00010000:00010000:3.0:1790100611.020278:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100611.020285:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020291:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe34c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020309:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020318:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020323:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020327:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21ffa00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100611.020330:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020336:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020342:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d678c398c00) 00010000:00010000:3.0:1790100611.020344:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100611.020347:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020351:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe353 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020395:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fea00/0x31a8f3fdeeefe345 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6509a expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020409:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ff200/0x31a8f3fdeeefe35a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6509a expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.020416:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d678c398700) 00010000:00010000:3.0:1790100611.020418:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100611.020421:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21ff200, rc 0) 00000100:00100000:3.0:1790100611.020490:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+7:14431:x1877056109527680:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1121us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100611.023119:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:3.0:1790100611.033067:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100611.033390:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109527936 00000100:00100000:2.0:1790100611.033402:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109527936 00000100:00100000:2.0:1790100611.033479:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:2.0:1790100611.033489:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+7:14431:x1877056109527936:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100611.033523:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100611.033542:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe361 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650a1 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.033786:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.033803:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.034474:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.034530:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.034539:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.034548:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035037:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefe376 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035047:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefe376 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035056:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefe376 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100611.035066:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790100611.035293:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035302:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035309:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035315:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100611.035320:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035327:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035341:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d678c398700) 00010000:00010000:2.0:1790100611.035344:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100611.035348:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035354:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe368 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035366:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035373:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035379:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035393:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100611.035396:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035402:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035410:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d6787def300) 00010000:00010000:2.0:1790100611.035412:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100611.035415:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.035421:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe36f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.037529:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe361 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650a1 expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.037556:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142c00/0x31a8f3fdeeefe376 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650a1 expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.037566:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def400) 00010000:00010000:2.0:1790100611.037569:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100611.037573:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142c00, rc 0) 00000100:00100000:2.0:1790100611.038048:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+9:14431:x1877056109527936:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 4556us (4987us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790100611.038058:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:1.0:1790100611.047769:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100611.051856:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109528064 00000100:00100000:3.0:1790100611.051873:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109528064 00000100:00100000:3.0:1790100611.051958:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:3.0:1790100611.051970:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+9:14431:x1877056109528064:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790100611.052107:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+9:14431:x1877056109528064:12345-192.168.201.18@tcp:59:lhsmtool_posix.0 Request processed in 139us (4349us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100611.052116:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1790100611.081356:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100611.081482:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109528192 00000100:00100000:2.0:1790100611.081518:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109528192 00000100:00100000:2.0:1790100611.081601:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:2.0:1790100611.081663:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6785129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+9:14437:x1877056109528192:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100611.081689:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100611.081720:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650a8 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.081786:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.081800:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.081811:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.081836:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.081844:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.081850:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082070:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082079:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082086:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082097:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100611.082101:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082109:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082122:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787defd00) 00010000:00010000:2.0:1790100611.082125:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100611.082130:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082135:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe38b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082147:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082153:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082164:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082169:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100611.082171:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082178:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082196:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6787def300) 00010000:00010000:2.0:1790100611.082199:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100611.082202:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082208:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe392 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082242:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe384 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650a8 expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082252:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787defd00) 00010000:00010000:2.0:1790100611.082254:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100611.082268:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650a8 expref: 10 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.082277:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143800, rc 0) 00000100:00100000:2.0:1790100611.082365:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6785129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+9:14437:x1877056109528192:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 754us (1025us total) trans 0 rc 301/301 00000100:00100000:2.0:1790100611.082373:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:0.0:1790100611.091439:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.091599:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109528320 00000100:00100000:1.0:1790100611.091629:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109528320 00000100:00100000:1.0:1790100611.091692:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1790100611.091703:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:18e88987-66d0-4240-a27c-27ca03f877ad+9:14437:x1877056109528320:12345-192.168.201.18@tcp:700:lfs.0 00000100:00100000:1.0:1790100611.091806:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:18e88987-66d0-4240-a27c-27ca03f877ad+9:14437:x1877056109528320:12345-192.168.201.18@tcp:700:lfs.0 Request processed in 104us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100611.091814:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1790100611.094328:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100611.100451:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109528576 00000100:00100000:3.0:1790100611.100467:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109528576 00000100:00100000:2.0:1790100611.101248:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:2.0:1790100611.101275:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+9:14437:x1877056109528576:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:2.0:1790100611.101341:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100611.101372:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe2c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65023 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.101395:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787defd00) 00010000:00010000:2.0:1790100611.101419:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100611.101886:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.101902:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65085 expref: 5 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.101912:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.101949:0:14381:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65085 expref: 5 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.101965:0:14381:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65085 expref: 5 pid: 14381 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100611.101982:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1877056126293504:192.168.201.18@tcp:104: 00000100:00100000:2.0:1790100611.102092:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ae80a300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100611.105951:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100611.106163:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14381:1877056126293504:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100611.106194:0:14381:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100611.106850:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109528704 00000100:00100000:3.0:1790100611.106933:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109528704 00010000:00010000:0.0:1790100611.107121:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65085 expref: 6 pid: 14381 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100611.107169:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:0.0:1790100611.107179:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5745a62d-b161-4567-a7f5-21880928c2da+6:2357:x1877056109528704:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100611.107195:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100611.107202:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65085 expref: 6 pid: 14381 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.107214:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65085 expref: 6 pid: 14381 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.107236:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143c00/0x31a8f3fdeeefe2ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65085 expref: 6 pid: 14381 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.107253:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787defd00) 00010000:00010000:0.0:1790100611.107269:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.107280:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.107286:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.107315:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100611.107367:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5745a62d-b161-4567-a7f5-21880928c2da+5:2357:x1877056109528704:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 189us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100611.107387:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00010000:00010000:2.0:1790100611.107446:0:14381:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.107455:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.107479:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.107511:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.107520:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100611.112770:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790100611.112794:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.112805:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.112813:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.112819:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100611.112824:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.112832:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.112849:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6787defd00) 00010000:00010000:2.0:1790100611.112853:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100611.112857:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.112864:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe399 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100611.112899:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cab9db9 reply state 0000000074a33170 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100611.112908:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100611.114323:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+10:14437:x1877056109528576:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 13050us (19991us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790100611.114336:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00080000:3.0:1790100611.115070:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790100611.120129:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.120146:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.120154:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.120160:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100611.120164:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.120173:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.120194:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6787def300) 00010000:00010000:2.0:1790100611.120198:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100611.120203:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.120210:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe3a0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100611.210364:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100611.210575:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109528832 00000100:00100000:3.0:1790100611.210600:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109528832 00000100:00100000:3.0:1790100611.210694:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:3.0:1790100611.210704:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+9:14445:x1877056109528832:12345-192.168.201.18@tcp:101:lctl.0 00010000:00010000:3.0:1790100611.210729:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100611.210754:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fea00/0x31a8f3fdeeefe3a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650af expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.210833:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe3ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.210847:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe3ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.210868:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe3ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100611.210908:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790100611.210911:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790100611.210953:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe3ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.210977:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fea00/0x31a8f3fdeeefe3a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650af expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.211001:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21ffa00/0x31a8f3fdeeefe3ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650af expref: 10 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.211011:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d678c398c00) 00010000:00010000:3.0:1790100611.211014:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790100611.211018:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21ffa00, rc 0) 00000100:00100000:3.0:1790100611.211098:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+10:14445:x1877056109528832:12345-192.168.201.18@tcp:101:lctl.0 Request processed in 395us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100611.211104:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 20 00000100:00100000:0.0:1790100611.233408:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100611.233490:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109528960 00000100:00100000:2.0:1790100611.233501:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109528960 00000100:00100000:2.0:1790100611.233563:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1790100611.233575:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+5:14446:x1877056109528960:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100611.233596:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100611.233641:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe3b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650b6 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.233713:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe3bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.233728:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe3bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.233740:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe3bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100611.233776:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790100611.233780:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100611.233800:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe3bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.233826:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe3b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650b6 expref: 7 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.233842:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142000/0x31a8f3fdeeefe3bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650b6 expref: 6 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.233851:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d678c398c00) 00010000:00010000:2.0:1790100611.233867:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100611.233872:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142000, rc 0) 00000100:00100000:2.0:1790100611.233943:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+6:14446:x1877056109528960:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 370us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100611.233950:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1790100611.241221:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.241429:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109529088 00000100:00100000:1.0:1790100611.241440:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109529088 00000100:00100000:1.0:1790100611.241503:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:1.0:1790100611.241513:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5745a62d-b161-4567-a7f5-21880928c2da+6:14446:x1877056109529088:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100611.241533:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100611.241553:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe3c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650bd expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.241677:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.241693:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.241706:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.241723:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.241730:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.241737:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242016:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe3d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242025:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242032:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100611.242066:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790100611.242069:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100611.242089:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242112:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242118:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242125:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242130:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100611.242134:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242140:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242152:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d678c398c00) 00010000:00010000:1.0:1790100611.242155:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100611.242161:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242166:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe3ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242179:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242184:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242189:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242201:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100611.242204:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242210:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242218:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100611.242221:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100611.242224:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242230:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242276:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe3c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650bd expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242291:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650bd expref: 7 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.242299:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:1.0:1790100611.242301:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790100611.242304:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12e00, rc 0) 00000100:00100000:1.0:1790100611.242422:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5745a62d-b161-4567-a7f5-21880928c2da+7:14446:x1877056109529088:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 909us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100611.242430:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:1.0:1790100611.258746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100611.265114:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109529344 00000100:00100000:3.0:1790100611.265129:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109529344 00000100:00100000:3.0:1790100611.265248:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:3.0:1790100611.265269:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5745a62d-b161-4567-a7f5-21880928c2da+7:14446:x1877056109529344:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:3.0:1790100611.265292:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100611.265314:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fea00/0x31a8f3fdeeefe3df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650c4 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790100611.265427:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790100611.265571:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fea00/0x31a8f3fdeeefe3df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650c4 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.265585:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d678c398c00) 00010000:00010000:3.0:1790100611.265589:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790100611.265593:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fea00/0x31a8f3fdeeefe3df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650c4 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.265804:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21fea00, rc 0) 00000100:00100000:3.0:1790100611.265872:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5745a62d-b161-4567-a7f5-21880928c2da+8:14446:x1877056109529344:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 614us (7136us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1790100611.265881:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:0.0:1790100611.274074:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.274153:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109529600 00000100:00100000:1.0:1790100611.274163:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109529600 00000100:00100000:1.0:1790100611.274224:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1790100611.274235:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5745a62d-b161-4567-a7f5-21880928c2da+8:14446:x1877056109529600:12345-192.168.201.18@tcp:36:lfs.0 00010000:00010000:1.0:1790100611.274302:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100611.274330:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe3d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650bd expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.274350:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6799df4000) 00010000:00010000:1.0:1790100611.274360:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790100611.274394:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.274408:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.274418:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100611.274673:0:14383:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e348361 reply state 000000003138f600 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100611.274683:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790100611.274690:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790100611.274772:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5745a62d-b161-4567-a7f5-21880928c2da+9:14446:x1877056109529600:12345-192.168.201.18@tcp:36:lfs.0 Request processed in 538us (709us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790100611.274779:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 24 00000100:00100000:1.0:1790100611.283219:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100611.285379:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109529856 00000100:00100000:3.0:1790100611.285394:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109529856 00000100:00100000:3.0:1790100611.285465:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1790100611.285476:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5745a62d-b161-4567-a7f5-21880928c2da+9:14446:x1877056109529856:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:3.0:1790100611.285777:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5745a62d-b161-4567-a7f5-21880928c2da+10:14446:x1877056109529856:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 301us (2568us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790100611.285785:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1790100611.290188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.290437:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109530112 00000100:00100000:1.0:1790100611.290448:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109530112 00000100:00100000:1.0:1790100611.290689:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 25 00000100:00100000:1.0:1790100611.290701:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5745a62d-b161-4567-a7f5-21880928c2da+10:14446:x1877056109530112:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100611.290726:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100611.290744:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe3f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650cb expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.290813:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.290828:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.290839:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.290853:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.290860:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.290869:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100611.290977:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790100611.291065:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291073:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291079:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291093:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100611.291097:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291105:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291117:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d678c398c00) 00010000:00010000:1.0:1790100611.291120:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100611.291125:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291131:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe3fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291142:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291147:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291153:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291158:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100611.291160:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291166:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291183:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6799df4000) 00010000:00010000:1.0:1790100611.291185:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100611.291188:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291194:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe402 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291231:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe3f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650cb expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291241:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d678c398c00) 00010000:00010000:1.0:1790100611.291243:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100611.291247:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe3f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650cb expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.291269:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12e00, rc 0) 00000100:00100000:1.0:1790100611.291342:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5745a62d-b161-4567-a7f5-21880928c2da+11:14446:x1877056109530112:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 643us (1161us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1790100611.291350:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 25 00010000:00010000:0.0:1790100611.292922:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.292938:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.292944:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.292951:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1790100611.292954:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.292962:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.292986:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6799df4d00) 00010000:00010000:0.0:1790100611.292989:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790100611.292993:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100611.292998:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe3ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100611.298106:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100611.298767:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109530240 00000100:00100000:2.0:1790100611.298779:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109530240 00000100:00100000:2.0:1790100611.298843:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:2.0:1790100611.298853:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+10:14446:x1877056109530240:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100611.298887:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100611.298909:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe410 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650d2 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.298999:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.299013:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.299025:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100611.299049:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790100611.299053:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790100611.299069:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.299093:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143800/0x31a8f3fdeeefe410 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d2 expref: 12 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.299130:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d2 expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.299138:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6787def300) 00010000:00010000:2.0:1790100611.299141:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790100611.299144:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785142800, rc 0) 00000100:00100000:2.0:1790100611.299211:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+11:14446:x1877056109530240:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 358us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100611.299219:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 26 00000100:00100000:3.0:1790100611.301761:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126293632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100611.301834:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100611.302835:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126293632 00000100:00100000:2.0:1790100611.302848:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126293632 00000100:00100000:2.0:1790100611.302927:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790100611.302938:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126293632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100611.302979:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790100611.303055:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126293632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100611.303062:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1790100611.303186:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790100611.303328:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126293632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790100611.316114:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.316227:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109530368 00000100:00100000:1.0:1790100611.316240:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109530368 00000100:00100000:1.0:1790100611.316318:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:1.0:1790100611.316329:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5745a62d-b161-4567-a7f5-21880928c2da+11:14446:x1877056109530368:12345-192.168.201.18@tcp:37:lfs.0 00000100:00100000:1.0:1790100611.321362:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5745a62d-b161-4567-a7f5-21880928c2da+11:14446:x1877056109530368:12345-192.168.201.18@tcp:37:lfs.0 Request processed in 5026us (5248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100611.321393:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:1.0:1790100611.333141:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100611.334671:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109530624 00000100:00100000:2.0:1790100611.334688:0:14384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109530624 00000100:00100000:2.0:1790100611.334821:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:2.0:1790100611.334833:0:14384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5745a62d-b161-4567-a7f5-21880928c2da+11:14446:x1877056109530624:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:2.0:1790100611.335209:0:14384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5745a62d-b161-4567-a7f5-21880928c2da+12:14446:x1877056109530624:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 378us (2078us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790100611.335217:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00010000:00010000:0.0:1790100611.429934:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790100611.456545:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.456734:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109530752 00000100:00100000:1.0:1790100611.456755:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109530752 00000100:00100000:1.0:1790100611.457074:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:1.0:1790100611.457087:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+10:14452:x1877056109530752:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1790100611.457111:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100611.457131:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe41e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650d9 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457197:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457213:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457227:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457242:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457249:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457269:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457360:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefe433 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457378:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefe433 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457386:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefe433 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100611.457414:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790100611.457417:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100611.457452:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefe433 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457464:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457470:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457477:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457483:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100611.457558:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457567:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457580:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d678c398c00) 00010000:00010000:1.0:1790100611.457583:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100611.457588:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457604:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457652:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457659:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457665:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457670:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100611.457672:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457678:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457686:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d6799df4000) 00010000:00010000:1.0:1790100611.457688:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100611.457691:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457696:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe42c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457727:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe41e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d9 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457986:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13e00/0x31a8f3fdeeefe433 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d9 expref: 11 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.457993:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6787def300) 00010000:00010000:1.0:1790100611.457995:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790100611.457997:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13e00, rc 0) 00000100:00100000:1.0:1790100611.458067:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+11:14452:x1877056109530752:12345-192.168.201.18@tcp:101:bash.0 Request processed in 983us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100611.458074:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 27 00000100:00100000:0.0:1790100611.464874:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100611.465157:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109531008 00000100:00100000:3.0:1790100611.465169:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109531008 00000100:00100000:3.0:1790100611.465244:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 28 00000100:00100000:3.0:1790100611.465265:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+11:14452:x1877056109531008:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:3.0:1790100611.465287:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100611.465308:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fea00/0x31a8f3fdeeefe43a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650e0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.465434:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.465449:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d2 expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.465458:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.465494:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d2 expref: 11 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.465528:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d2 expref: 11 pid: 14381 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100611.465542:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6787773480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126293760:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100611.465694:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6788dc7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790100611.469202:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6787773480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126293760:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100611.469236:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100611.471865:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100611.472236:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109531136 00000100:00100000:3.0:1790100611.472248:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109531136 00010000:00010000:3.0:1790100611.472301:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d2 expref: 12 pid: 14381 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100611.472351:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:3.0:1790100611.472361:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5745a62d-b161-4567-a7f5-21880928c2da+12:2358:x1877056109531136:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100611.472376:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100611.472383:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d2 expref: 12 pid: 14381 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.472397:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d2 expref: 12 pid: 14381 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.472418:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142800/0x31a8f3fdeeefe417 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650d2 expref: 12 pid: 14381 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.472448:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6787def300) 00010000:00010000:3.0:1790100611.472454:0:14369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.472464:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.472472:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100611.472515:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100611.472583:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5745a62d-b161-4567-a7f5-21880928c2da+11:2358:x1877056109531136:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 222us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100611.472590:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00010000:00010000:1.0:1790100611.473063:0:14382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.473072:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.473097:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.473108:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.473117:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.474249:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.474276:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.474299:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100611.474313:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790100611.474343:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.474350:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.474357:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.474364:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fec00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100611.474369:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.474377:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.474388:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6787def300) 00010000:00010000:1.0:1790100611.474391:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100611.474396:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.474403:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fec00/0x31a8f3fdeeefe441 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790100611.474423:0:14382:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c936227 reply state 000000009de327f9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100611.474441:0:14382:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790100611.476570:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67c21fea00/0x31a8f3fdeeefe43a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e0 expref: 14 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.476636:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e0 expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.476645:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100611.476648:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790100611.476651:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13200, rc 0) 00000100:00100000:1.0:1790100611.476883:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+14:14452:x1877056109531008:12345-192.168.201.18@tcp:101:bash.0 Request processed in 11628us (12017us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790100611.476892:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 28 00010000:00010000:2.0:1790100611.484949:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.484966:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.484975:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.484982:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100611.484987:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.484994:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.485012:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d6799df4000) 00010000:00010000:2.0:1790100611.485015:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100611.485019:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.485025:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe448 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100611.508128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.508397:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109531264 00000100:00100000:1.0:1790100611.508410:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109531264 00000100:00100000:1.0:1790100611.508475:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:1.0:1790100611.508496:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+13:14452:x1877056109531264:12345-192.168.201.18@tcp:101:bash.0 00010000:00010000:1.0:1790100611.508524:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100611.508546:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe45d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650e7 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.508673:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.508689:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.508720:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100611.508765:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790100611.508770:0:14383:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100611.508792:0:14383:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.508803:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.508829:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe45d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e7 expref: 15 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.508857:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e7 expref: 14 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.508865:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100611.508868:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100611.508872:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12e00, rc 0) 00000100:00100000:1.0:1790100611.508948:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+14:14452:x1877056109531264:12345-192.168.201.18@tcp:101:bash.0 Request processed in 464us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100611.508955:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 29 00000100:00100000:0.0:1790100611.513160:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.513396:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109531520 00000100:00100000:1.0:1790100611.513409:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109531520 00000100:00100000:1.0:1790100611.513463:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:1.0:1790100611.513472:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+14:14452:x1877056109531520:12345-192.168.201.18@tcp:35:bash.0 00000100:00100000:1.0:1790100611.513894:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+15:14452:x1877056109531520:12345-192.168.201.18@tcp:35:bash.0 Request processed in 422us (745us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790100611.513918:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1790100611.603149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.603277:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109531776 00000100:00100000:1.0:1790100611.603288:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109531776 00000100:00100000:1.0:1790100611.603353:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:1.0:1790100611.603364:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+15:14462:x1877056109531776:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:1.0:1790100611.603398:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100611.603417:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe46b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650ee expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100611.603521:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790100611.603679:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe46b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650ee expref: 17 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.603693:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d678c398c00) 00010000:00010000:1.0:1790100611.603696:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100611.603702:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe46b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650ee expref: 17 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.603716:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12c00, rc 0) 00000100:00100000:1.0:1790100611.603767:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+16:14462:x1877056109531776:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 404us (629us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1790100611.603774:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 30 00000100:00100000:3.0:1790100611.613809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.613928:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109532032 00000100:00100000:1.0:1790100611.613949:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109532032 00000100:00100000:1.0:1790100611.614009:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1790100611.614021:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+16:14462:x1877056109532032:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:1.0:1790100611.614237:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+17:14462:x1877056109532032:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 219us (436us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790100611.614243:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:0.0:1790100611.660163:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100611.660835:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109532288 00000100:00100000:2.0:1790100611.660847:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109532288 00000100:00100000:2.0:1790100611.660906:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:2.0:1790100611.660916:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+17:14465:x1877056109532288:12345-192.168.201.18@tcp:101:lfs.0 00010000:00010000:2.0:1790100611.660942:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100611.660961:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe479 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650f5 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.661091:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe480 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.661105:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe480 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.661117:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe480 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790100611.661128:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790100611.661288:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe479 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650f5 expref: 20 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.661309:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe480 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650f5 expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.661317:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:2.0:1790100611.661319:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790100611.661323:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143000, rc 0) 00000100:00100000:2.0:1790100611.661745:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+19:14465:x1877056109532288:12345-192.168.201.18@tcp:101:lfs.0 Request processed in 828us (1590us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790100611.661754:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 31 00000100:00100000:3.0:1790100611.666365:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100611.666406:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100611.666483:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109532544 00000100:00100000:2.0:1790100611.666493:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109532544 00000100:00100000:2.0:1790100611.666563:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:2.0:1790100611.666574:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+19:14465:x1877056109532544:12345-192.168.201.18@tcp:54:lfs.0 00010000:00010000:2.0:1790100611.666667:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.666699:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.666714:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.666760:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.666768:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.666775:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.666781:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100611.666786:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.666794:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.666806:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:2.0:1790100611.666810:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790100611.666825:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100611.666831:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe48e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100611.666919:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+19:14465:x1877056109532544:12345-192.168.201.18@tcp:54:lfs.0 Request processed in 346us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100611.666933:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 32 00000100:00100000:1.0:1790100611.669272:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109532416 00000100:00100000:1.0:1790100611.669291:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109532416 00000100:00100000:1.0:1790100611.669390:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1790100611.669402:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e88987-66d0-4240-a27c-27ca03f877ad+19:2357:x1877056109532416:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100611.669419:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100611.669446:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe480 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650f5 expref: 19 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100611.669470:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100611.669475:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100611.669967:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e88987-66d0-4240-a27c-27ca03f877ad+18:2357:x1877056109532416:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 565us (3608us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100611.669977:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:3.0:1790100611.676232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100611.677158:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109532800 00000100:00100000:1.0:1790100611.677170:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109532800 00000100:00100000:0.0:1790100611.677387:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:0.0:1790100611.677399:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+18:14465:x1877056109532800:12345-192.168.201.18@tcp:35:lfs.0 00000100:00100000:0.0:1790100611.678068:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+19:14465:x1877056109532800:12345-192.168.201.18@tcp:35:lfs.0 Request processed in 669us (1846us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790100611.678077:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00000040:00080000:1.0:1790100611.879287:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790100612.136485:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.136591:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109533056 00000100:00100000:1.0:1790100612.136603:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109533056 00000100:00100000:1.0:1790100612.136721:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:1.0:1790100612.136731:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+19:14496:x1877056109533056:12345-192.168.201.18@tcp:101:cat.0 00010000:00010000:1.0:1790100612.136767:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100612.136788:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe495 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc650fc expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.136947:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe49c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.136967:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe49c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.136979:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe49c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100612.136991:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790100612.137327:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe495 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650fc expref: 22 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.137349:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe49c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650fc expref: 21 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.137360:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100612.137363:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100612.137367:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13a00, rc 0) 00000100:00100000:1.0:1790100612.137438:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+21:14496:x1877056109533056:12345-192.168.201.18@tcp:101:cat.0 Request processed in 707us (963us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1790100612.137448:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:3.0:1790100612.142038:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100612.143017:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109533312 00000100:00100000:2.0:1790100612.143030:0:14384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109533312 00000100:00100000:2.0:1790100612.143137:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:2.0:1790100612.143148:0:14384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e88987-66d0-4240-a27c-27ca03f877ad+21:14496:x1877056109533312:12345-192.168.201.18@tcp:35:cat.0 00000100:00100000:2.0:1790100612.143521:0:14384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e88987-66d0-4240-a27c-27ca03f877ad+22:14496:x1877056109533312:12345-192.168.201.18@tcp:35:cat.0 Request processed in 374us (1493us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1790100612.143529:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 8 00000100:00100000:3.0:1790100612.149068:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.149193:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109533440 00000100:00100000:1.0:1790100612.149203:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109533440 00000100:00100000:1.0:1790100612.149276:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:1.0:1790100612.149286:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e88987-66d0-4240-a27c-27ca03f877ad+22:2360:x1877056109533440:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100612.149301:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100612.149335:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe49c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650fc expref: 22 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.149354:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100612.149359:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100612.149406:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e88987-66d0-4240-a27c-27ca03f877ad+21:2360:x1877056109533440:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 122us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100612.149413:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1790100612.228137:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.228264:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109533696 00000100:00100000:1.0:1790100612.228274:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109533696 00000100:00100000:1.0:1790100612.228337:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:1.0:1790100612.228356:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+21:14502:x1877056109533696:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:1.0:1790100612.228389:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100612.228408:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4aa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65103 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.228526:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.228541:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e0 expref: 22 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.228551:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e7 expref: 22 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.228560:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.228597:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e7 expref: 22 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.228664:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e7 expref: 22 pid: 14383 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100612.228679:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad534a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126293888:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100612.228794:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e0 expref: 22 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.228805:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e0 expref: 22 pid: 14382 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100612.228815:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad535f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126294016:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100612.228837:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790100612.232378:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100612.232584:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad534a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126293888:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100612.232901:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109533824 00000100:00100000:3.0:1790100612.232912:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109533824 00010000:00010000:3.0:1790100612.232966:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e7 expref: 23 pid: 14383 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100612.232987:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad535f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126294016:192.168.201.18@tcp:104: 00010000:00010000:2.0:1790100612.233042:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100612.233061:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1790100612.233074:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bc813050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e88987-66d0-4240-a27c-27ca03f877ad+23:2358:x1877056109533824:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100612.233097:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100612.233106:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e7 expref: 23 pid: 14383 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100612.233120:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e7 expref: 23 pid: 14383 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100612.233147:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe464 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e7 expref: 23 pid: 14383 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100612.233179:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:3.0:1790100612.233193:0:14369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100612.233204:0:14369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100612.233211:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790100612.233294:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bc813050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e88987-66d0-4240-a27c-27ca03f877ad+22:2358:x1877056109533824:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 223us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100612.233302:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:3.0:1790100612.237331:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.238762:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109533952 00000100:00100000:1.0:1790100612.238781:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109533952 00010000:00010000:1.0:1790100612.238842:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e0 expref: 22 pid: 14382 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100612.238897:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 12 00000100:00100000:1.0:1790100612.238909:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e88987-66d0-4240-a27c-27ca03f877ad+22:2357:x1877056109533952:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100612.238927:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100612.238935:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e0 expref: 22 pid: 14382 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.238951:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e0 expref: 22 pid: 14382 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.239001:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe44f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc650e0 expref: 22 pid: 14382 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.239021:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100612.239026:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.239039:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.239049:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.239091:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100612.239184:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e88987-66d0-4240-a27c-27ca03f877ad+21:2357:x1877056109533952:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 277us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100612.239316:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 12 00010000:00010000:0.0:1790100612.239921:0:14382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100612.239941:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100612.239968:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790100612.240176:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4aa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65103 expref: 22 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100612.240200:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12c00/0x31a8f3fdeeefe4b1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65103 expref: 21 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100612.240208:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:0.0:1790100612.240211:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790100612.240214:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12c00, rc 0) 00000100:00100000:0.0:1790100612.240305:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+21:14502:x1877056109533696:12345-192.168.201.18@tcp:101:dd.0 Request processed in 11957us (12178us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1790100612.240314:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:1.0:1790100612.244330:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100612.246543:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109534208 00000100:00100000:2.0:1790100612.246564:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109534208 00000100:00100000:2.0:1790100612.246691:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 35 00000100:00100000:2.0:1790100612.246704:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+21:14502:x1877056109534208:12345-192.168.201.18@tcp:36:dd.0 00010000:00010000:2.0:1790100612.246990:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.247010:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.247022:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100612.247077:0:14383:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1790100612.247129:0:14383:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000363d8286 reply state 000000004c584d9a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100612.247138:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100612.247257:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+24:14502:x1877056109534208:12345-192.168.201.18@tcp:36:dd.0 Request processed in 555us (2942us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1790100612.247264:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 35 00000020:00080000:2.0:1790100612.247270:0:14383:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790100612.251997:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.252022:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.252031:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.252039:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100612.252045:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.252055:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.252079:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:2.0:1790100612.252083:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100612.252090:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.252098:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe4bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100612.258193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100612.258324:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109534336 00000100:00100000:0.0:1790100612.258363:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109534336 00000100:00100000:0.0:1790100612.258513:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1790100612.258525:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+23:14502:x1877056109534336:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:0.0:1790100612.258558:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100612.258581:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefe4c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc6510a expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100612.258707:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefe4c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6510a expref: 24 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100612.258726:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefe4c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6510a expref: 24 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100612.258748:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:0.0:1790100612.258752:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790100612.258757:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad819000, rc 0) 00000100:00100000:0.0:1790100612.258854:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+24:14502:x1877056109534336:12345-192.168.201.18@tcp:101:dd.0 Request processed in 331us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100612.258861:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 36 00000100:00100000:0.0:1790100612.277911:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.278042:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109534592 00000100:00100000:1.0:1790100612.278054:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109534592 00000100:00100000:1.0:1790100612.278125:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:1.0:1790100612.278136:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e88987-66d0-4240-a27c-27ca03f877ad+24:14502:x1877056109534592:12345-192.168.201.18@tcp:103:dd.0 00010000:00010000:1.0:1790100612.278153:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100612.278182:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefe4c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6510a expref: 24 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.278225:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100612.278231:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100612.278312:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e88987-66d0-4240-a27c-27ca03f877ad+23:14502:x1877056109534592:12345-192.168.201.18@tcp:103:dd.0 Request processed in 177us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100612.278321:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:3.0:1790100612.282390:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100612.282717:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109534720 00000100:00100000:2.0:1790100612.282766:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109534720 00000100:00100000:2.0:1790100612.282849:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:2.0:1790100612.282861:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+23:14502:x1877056109534720:12345-192.168.201.18@tcp:58:dd.0 00010000:00010000:2.0:1790100612.282992:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.283015:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.283030:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790100612.287295:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790100612.287687:0:14383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1790100612.287782:0:14383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1790100612.288016:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+23:14502:x1877056109534720:12345-192.168.201.18@tcp:58:dd.0 Request processed in 5148us (5642us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100612.288030:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 37 00000100:00100000:2.0:1790100612.291273:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.291675:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109534848 00000100:00100000:1.0:1790100612.291694:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109534848 00000100:00100000:1.0:1790100612.291783:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 38 00000100:00100000:1.0:1790100612.291797:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+23:14502:x1877056109534848:12345-192.168.201.18@tcp:101:dd.0 00010000:00010000:1.0:1790100612.291827:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100612.291857:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe4d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65111 expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.291949:0:14381:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.291963:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe4d4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65111 expref: 24 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.291990:0:14381:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.292007:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe4d4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65111 expref: 24 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.292023:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100612.292044:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790100612.292049:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe4d4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65111 expref: 24 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.292057:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13200, rc 0) 00000100:00100000:1.0:1790100612.292376:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+24:14502:x1877056109534848:12345-192.168.201.18@tcp:101:dd.0 Request processed in 581us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100612.292384:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 38 00010000:00010000:1.0:1790100612.454263:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790100612.902681:0:14416:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790100612.902692:0:14416:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790100612.902727:0:14416:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790100612.902733:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790100612.902876:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad537800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14416:1877056126294144:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790100612.902992:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67857e2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790100612.913321:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100612.913442:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109534976 00000100:00100000:0.0:1790100612.913451:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109534976 00000100:00100000:0.0:1790100612.913501:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:0.0:1790100612.913511:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:18e88987-66d0-4240-a27c-27ca03f877ad+25:14503:x1877056109534976:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790100612.913601:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:18e88987-66d0-4240-a27c-27ca03f877ad+25:14503:x1877056109534976:12345-192.168.201.18@tcp:900:lhsmtool_posix.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100612.913641:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:1.0:1790100612.916646:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad537800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14416:1877056126294144:192.168.201.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790100612.916714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100612.916926:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109535104 00000100:00100000:2.0:1790100612.916936:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109535104 00000100:00100000:2.0:1790100612.917049:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:2.0:1790100612.917061:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+24:14503:x1877056109535104:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790100612.917097:0:14383:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790100612.917242:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+24:14503:x1877056109535104:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 183us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100612.917250:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 39 00000100:00100000:3.0:1790100612.924153:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.924529:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109535232 00000100:00100000:1.0:1790100612.924547:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109535232 00000100:00100000:1.0:1790100612.924688:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:1.0:1790100612.924700:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d678512a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+24:14503:x1877056109535232:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790100612.924792:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.924811:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.924822:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.924891:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.924899:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.924905:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.924929:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.924937:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.924944:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100612.924989:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790100612.924993:0:14381:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790100612.925008:0:14381:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925020:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925027:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925034:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925049:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100612.925054:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925061:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925074:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def400) 00010000:00010000:1.0:1790100612.925077:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100612.925082:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925088:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13600/0x31a8f3fdeeefe4db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925101:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925107:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925114:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925119:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100612.925122:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925128:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925144:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d6799df4800) 00010000:00010000:1.0:1790100612.925146:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100612.925149:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925155:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13a00/0x31a8f3fdeeefe4e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925168:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925174:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925180:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925186:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e12e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100612.925188:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925194:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925201:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100612.925204:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790100612.925207:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.925212:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe4e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100612.925304:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d678512a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+24:14503:x1877056109535232:12345-192.168.201.18@tcp:34:lhsmtool_posix.0 Request processed in 605us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100612.925312:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 40 00000100:00100000:2.0:1790100612.933974:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.934343:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109535488 00000100:00100000:1.0:1790100612.934358:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109535488 00000100:00100000:1.0:1790100612.934435:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:1.0:1790100612.934446:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+24:14503:x1877056109535488:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100612.934467:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100612.934488:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe4f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65118 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934591:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934607:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934650:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790100612.934662:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790100612.934758:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934767:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934774:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934800:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1790100612.934804:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934812:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934824:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:1.0:1790100612.934827:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790100612.934832:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934838:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe4f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934877:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe4f0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65118 expref: 26 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934887:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6787def400) 00010000:00010000:1.0:1790100612.934889:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790100612.934893:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe4f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65118 expref: 26 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.934902:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13400, rc 0) 00000100:00100000:1.0:1790100612.934970:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+25:14503:x1877056109535488:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 525us (1010us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1790100612.934978:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 41 00000100:00100000:3.0:1790100612.938006:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100612.938733:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109535616 00000100:00100000:2.0:1790100612.938758:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109535616 00000100:00100000:2.0:1790100612.938833:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:2.0:1790100612.938845:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67b5a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+25:14503:x1877056109535616:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790100612.938899:0:14383:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790100612.939053:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67b5a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+25:14503:x1877056109535616:12345-192.168.201.18@tcp:53:lhsmtool_posix.0 Request processed in 209us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100612.939062:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 42 00000100:00100000:3.0:1790100612.944559:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.944676:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109535872 00000100:00100000:1.0:1790100612.944718:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109535872 00000100:00100000:1.0:1790100612.944802:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:1.0:1790100612.944815:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+25:14503:x1877056109535872:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100612.944839:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100612.944860:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe505 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc6511f expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790100612.945496:0:14382:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1790100612.945505:0:14382:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1790100612.945556:0:14382:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1790100612.945836:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe50c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.945849:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe50c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.945857:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe50c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.945898:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe505 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6511f expref: 28 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.945912:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe50c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6511f expref: 27 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.945920:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:1.0:1790100612.945923:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790100612.945926:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13800, rc 0) 00000100:00100000:1.0:1790100612.945985:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+27:14503:x1877056109535872:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 1174us (1625us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1790100612.945996:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 43 00000100:00100000:3.0:1790100612.956948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100612.957185:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109536128 00000100:00100000:2.0:1790100612.957199:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109536128 00000100:00100000:2.0:1790100612.957317:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:2.0:1790100612.957328:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+27:14503:x1877056109536128:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100612.957427:0:14383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100612.957468:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe50c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6511f expref: 27 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.957495:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4800) 00010000:00010000:2.0:1790100612.957510:0:14383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100612.957545:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.957561:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.957573:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.957588:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.957595:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.957602:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961277:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961366:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961375:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961381:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100612.961386:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961395:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961411:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6787def300) 00010000:00010000:2.0:1790100612.961414:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100612.961420:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961426:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe51a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961441:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961447:0:14383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961453:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961476:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100612.961479:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961485:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961494:0:14383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd4b00231 (ffff8d6787defd00) 00010000:00010000:2.0:1790100612.961496:0:14383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100612.961499:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.961505:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe521 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd4b00231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100612.961670:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+26:14503:x1877056109536128:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 4324us (4716us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790100612.961679:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 44 00000100:00100000:0.0:1790100612.967273:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100612.967464:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109536256 00000100:00100000:1.0:1790100612.967475:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109536256 00000100:00100000:1.0:1790100612.967541:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:1.0:1790100612.967552:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+26:14503:x1877056109536256:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100612.967576:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100612.967600:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe528 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65126 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.967682:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe52f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.967700:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe52f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.967713:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe52f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.967812:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe528 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65126 expref: 28 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.967831:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e12e00/0x31a8f3fdeeefe52f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65126 expref: 27 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100612.967839:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4300) 00010000:00010000:1.0:1790100612.967842:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790100612.967846:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e12e00, rc 0) 00000100:00100000:1.0:1790100612.967908:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+27:14503:x1877056109536256:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 357us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100612.967921:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 45 00000100:00100000:3.0:1790100612.974980:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100612.975097:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109536512 00000100:00100000:2.0:1790100612.975114:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109536512 00000100:00100000:2.0:1790100612.975192:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 46 00000100:00100000:2.0:1790100612.975205:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+27:14503:x1877056109536512:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100612.975427:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.975444:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.975457:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790100612.976193:0:14383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1790100612.976206:0:14383:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 509545594118ns, next at 510545591028ns, rc = 0 00000004:00010000:2.0:1790100612.976702:0:14383:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b239609 reply state 0000000016d9b3e0 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100612.976714:0:14383:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100612.976832:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+29:14503:x1877056109536512:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 1628us (1868us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790100612.976840:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 46 00010000:00010000:2.0:1790100612.985301:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.985319:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.985328:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.985334:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100612.985339:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.985346:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.985363:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4300) 00010000:00010000:2.0:1790100612.985366:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790100612.985371:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.985404:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143000/0x31a8f3fdeeefe536 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100612.986786:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100612.986923:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109536640 00000100:00100000:2.0:1790100612.986932:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109536640 00000100:00100000:2.0:1790100612.986986:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:2.0:1790100612.986995:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+28:14503:x1877056109536640:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790100612.987018:0:14381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790100612.987036:0:14381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc6512d expref: -99 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.987093:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6512d expref: 29 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.987107:0:14381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6512d expref: 29 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100612.987124:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4300) 00010000:00010000:2.0:1790100612.987127:0:14381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100612.987131:0:14381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6785143600, rc 0) 00000100:00100000:2.0:1790100612.987177:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+29:14503:x1877056109536640:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 183us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100612.987183:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 47 00000100:00100000:3.0:1790100613.000444:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100613.000593:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109536768 00000100:00100000:2.0:1790100613.000809:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109536768 00000100:00100000:2.0:1790100613.000899:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1790100613.000912:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+5:2358:x1877056109536768:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1790100613.001160:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790100613.002169:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+6:2358:x1877056109536768:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 1255us (1735us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790100613.002179:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:0.0:1790100613.016063:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100613.016320:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109537024 00000100:00100000:3.0:1790100613.016332:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109537024 00000100:00100000:3.0:1790100613.016398:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00100000:3.0:1790100613.016409:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+29:14503:x1877056109537024:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790100613.016811:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+30:14503:x1877056109537024:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 402us (758us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1790100613.016819:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 9 00000100:00080000:0.0:1790100613.019491:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790100613.020727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100613.020813:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109537280 00000100:00100000:2.0:1790100613.020823:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109537280 00000100:00100000:2.0:1790100613.020886:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:2.0:1790100613.020899:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+30:14503:x1877056109537280:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790100613.021035:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e88987-66d0-4240-a27c-27ca03f877ad+30:14503:x1877056109537280:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 138us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100613.021044:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 48 00000100:00100000:1.0:1790100613.031442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100613.032207:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109537408 00000100:00100000:0.0:1790100613.032221:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109537408 00000100:00100000:0.0:1790100613.032377:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:0.0:1790100613.032390:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+30:14503:x1877056109537408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790100613.032411:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790100613.032433:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefe544 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65134 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.032521:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefe54b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.032536:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefe54b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.032549:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefe54b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790100613.032590:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790100613.032641:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefe54b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.032679:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad819000/0x31a8f3fdeeefe544 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65134 expref: 32 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.032696:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefe54b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65134 expref: 31 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.032719:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4300) 00010000:00010000:0.0:1790100613.032722:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790100613.032726:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67ad818400, rc 0) 00000100:00100000:0.0:1790100613.032797:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+31:14503:x1877056109537408:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 410us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100613.032804:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 49 00000100:00100000:0.0:1790100613.035882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100613.035961:0:16367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109537536 00000100:00100000:3.0:1790100613.035972:0:16367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109537536 00000100:00100000:3.0:1790100613.036058:0:16367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:3.0:1790100613.036070:0:16367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:18e88987-66d0-4240-a27c-27ca03f877ad+6:2358:x1877056109537536:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790100613.036087:0:16367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790100613.036105:0:16367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc6513b expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790100613.036151:0:16367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab2c484, blocks: 0x1 00010000:00010000:3.0:1790100613.036169:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1790100613.036174:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.036182:0:16367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6513b expref: 7 pid: 16367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.036202:0:16367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6513b expref: 7 pid: 16367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.036215:0:16367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67c21fe000, rc 0) 00000100:00100000:3.0:1790100613.036287:0:16367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:18e88987-66d0-4240-a27c-27ca03f877ad+7:2358:x1877056109537536:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 219us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100613.036294:0:16367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:0.0:1790100613.048312:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100613.048564:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109537792 00000100:00100000:1.0:1790100613.048576:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109537792 00000100:00100000:1.0:1790100613.048935:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:1.0:1790100613.048948:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+31:14503:x1877056109537792:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790100613.049090:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+31:14503:x1877056109537792:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 145us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100613.049098:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 50 00000100:00100000:1.0:1790100613.057070:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100613.057521:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109537920 00000100:00100000:0.0:1790100613.057533:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109537920 00000100:00100000:0.0:1790100613.057600:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:0.0:1790100613.057648:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+31:14503:x1877056109537920:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790100613.109794:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:3.0:1790100613.109928:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1790100613.109950:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1790100613.109958:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1790100613.109962:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1790100613.109997:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1790100613.110007:0:5863:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1790100613.110205:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790100613.110691:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+14:14503:x1877056109537920:12345-192.168.201.18@tcp:44:lhsmtool_posix.0 Request processed in 53076us (53626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100613.110703:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 51 00000100:00100000:1.0:1790100613.111849:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126294272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790100613.111912:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100613.112069:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126294272 00000100:00100000:3.0:1790100613.112077:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126294272 00000100:00100000:3.0:1790100613.112175:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790100613.112184:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126294272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790100613.112434:0:15066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790100613.112450:0:15066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1790100613.112452:0:15066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790100613.112455:0:15066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790100612 -> 1790100612 00002000:00010000:3.0:1790100613.112519:0:15066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790100613.112569:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1877056126294272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 385us (655us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1790100613.112577:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1790100613.112708:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d67ad87e680/2, rc 0, transno 8589934595 00000100:00100000:1.0:1790100613.112715:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126294272:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1790100613.112811:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100613.114254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100613.114338:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109538048 00000100:00100000:3.0:1790100613.114347:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109538048 00000100:00100000:3.0:1790100613.114547:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1790100613.114559:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18e88987-66d0-4240-a27c-27ca03f877ad+7:2357:x1877056109538048:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790100613.114701:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18e88987-66d0-4240-a27c-27ca03f877ad+7:2357:x1877056109538048:12345-192.168.201.18@tcp:16:lhsmtool_posix.0 Request processed in 145us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100613.114709:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 16 00000100:00100000:3.0:1790100613.122966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100613.125696:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109538304 00000100:00100000:1.0:1790100613.125712:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109538304 00000100:00100000:2.0:1790100613.126058:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:2.0:1790100613.126071:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+14:14503:x1877056109538304:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790100613.126125:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790100613.126148:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818400/0x31a8f3fdeeefe54b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65134 expref: 14 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.126164:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4300) 00010000:00010000:2.0:1790100613.126168:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790100613.126193:0:14381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.126205:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.126211:0:14381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790100613.126850:0:14381:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000106b9f82 reply state 000000005995deda transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100613.126862:0:14381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790100613.126968:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+15:14503:x1877056109538304:12345-192.168.201.18@tcp:36:lhsmtool_posix.0 Request processed in 899us (4010us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1790100613.126977:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 52 00000100:00100000:0.0:1790100613.132582:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00010000:00010000:3.0:1790100613.132722:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.132735:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.132742:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.132748:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785142400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1790100613.132753:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.132761:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.132798:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4300) 00010000:00010000:3.0:1790100613.132801:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790100613.132807:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.132813:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785142400/0x31a8f3fdeeefe559 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100613.132990:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109538432 00000100:00100000:1.0:1790100613.133000:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109538432 00000100:00100000:1.0:1790100613.133075:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 17 00000100:00100000:1.0:1790100613.133085:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e88987-66d0-4240-a27c-27ca03f877ad+7:14503:x1877056109538432:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790100613.133102:0:15066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790100613.133121:0:15066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7e7a2353edc65142 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.133147:0:15066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6513b expref: 8 pid: 16367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.133162:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100613.133166:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100613.133171:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.133205:0:15066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6513b expref: 8 pid: 16367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.133218:0:15066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6513b expref: 8 pid: 16367 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100613.133243:0:15066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad536d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15066:1877056126294400:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100613.133338:0:15066:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a943a300 going to sleep for 11 seconds 00000100:00100000:0.0:1790100613.138232:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100613.138304:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109538560 00000100:00100000:3.0:1790100613.138312:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109538560 00000100:00100000:1.0:1790100613.138325:0:15066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad536d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15066:1877056126294400:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100613.138357:0:15066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 9 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.138362:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6513b expref: 9 pid: 16367 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.138379:0:15066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d67b5e13600, rc 0) 00000100:00100000:3.0:1790100613.138404:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:3.0:1790100613.138414:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e88987-66d0-4240-a27c-27ca03f877ad+9:2357:x1877056109538560:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790100613.138428:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790100613.138451:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6513b expref: 9 pid: 16367 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.138476:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6513b expref: 9 pid: 16367 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.138500:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe552 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6513b expref: 9 pid: 16367 timeout: 609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.138517:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.138535:0:14369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.138543:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.138555:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100613.138570:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e88987-66d0-4240-a27c-27ca03f877ad+8:14503:x1877056109538432:12345-192.168.201.18@tcp:101:lhsmtool_posix.0 Request processed in 5487us (5998us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100613.138577:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 17 00010000:00010000:3.0:1790100613.138589:0:14369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100613.138602:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14369:1877056126294528:192.168.201.18@tcp:105: 00000100:00100000:3.0:1790100613.138694:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad960840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100613.141846:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14369:1877056126294528:192.168.201.18@tcp:105: 00010000:00010000:0.0:1790100613.141872:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100613.141940:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e88987-66d0-4240-a27c-27ca03f877ad+7:2357:x1877056109538560:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 3527us (3731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100613.141951:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 13 00000100:00100000:2.0:1790100613.142577:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100613.142890:0:16367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109538688 00000100:00100000:1.0:1790100613.142899:0:16367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109538688 00000100:00100000:1.0:1790100613.142971:0:16367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1790100613.142979:0:16367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:18e88987-66d0-4240-a27c-27ca03f877ad+7:2357:x1877056109538688:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790100613.143170:0:16367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790100613.143173:0:16367:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790100611 00002000:00010000:1.0:1790100613.143175:0:16367:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790100610 00002000:00010000:1.0:1790100613.143177:0:16367:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790100612 -> 1790100611 00002000:00010000:1.0:1790100613.143178:0:16367:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790100613.143217:0:16367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:18e88987-66d0-4240-a27c-27ca03f877ad+8:2357:x1877056109538688:12345-192.168.201.18@tcp:2:lhsmtool_posix.0 Request processed in 239us (643us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790100613.143231:0:16367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 18 00000100:00100000:1.0:1790100613.149468:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100613.149560:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109538816 00000100:00100000:3.0:1790100613.149571:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109538816 00000100:00100000:3.0:1790100613.149657:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:3.0:1790100613.149665:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+8:2360:x1877056109538816:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790100613.149706:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.149722:0:15063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.149728:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.149731:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790100613.149734:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.149777:0:15063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.149788:0:15063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 8 pid: 15066 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100613.149799:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15063:1877056126294656:192.168.201.18@tcp:104: 00000100:00100000:3.0:1790100613.149881:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad960240 going to sleep for 11 seconds 00000100:00100000:0.0:1790100613.153358:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100613.153453:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109538944 00000100:00100000:1.0:1790100613.153463:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109538944 00010000:00010000:1.0:1790100613.153506:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 9 pid: 15066 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100613.153546:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 14 00000100:00100000:1.0:1790100613.153554:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e88987-66d0-4240-a27c-27ca03f877ad+9:2358:x1877056109538944:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790100613.153570:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790100613.153590:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 9 pid: 15066 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.153602:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 9 pid: 15066 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.153664:0:14368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100613.153679:0:14368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790100613.153685:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.153693:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.153711:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790100613.153771:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e88987-66d0-4240-a27c-27ca03f877ad+9:2358:x1877056109538944:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 217us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790100613.153779:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 14 00010000:00010000:3.0:1790100613.154192:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbed7f2a/0x31a8f3fdeeefe560 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65142 expref: 8 pid: 15066 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100613.154212:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15063:1877056126294656:192.168.201.18@tcp:104: 00010000:00010000:3.0:1790100613.154305:0:15063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.154318:0:15063:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.154325:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.154353:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.154375:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.154385:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.154392:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fe000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100613.154396:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.154406:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.154420:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.154426:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe567 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100613.154500:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e88987-66d0-4240-a27c-27ca03f877ad+7:2360:x1877056109538816:12345-192.168.201.18@tcp:1:lhsmtool_posix.0 Request processed in 4835us (5041us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100613.154508:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 19 00000100:00100000:0.0:1790100613.157997:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100613.158192:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109539200 00000100:00100000:1.0:1790100613.158203:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109539200 00000100:00100000:1.0:1790100613.158300:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 53 00000100:00100000:1.0:1790100613.158311:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+14:14503:x1877056109539200:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790100613.158410:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.158427:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.158439:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.158729:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.158742:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6512d expref: 15 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.158762:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.158798:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6512d expref: 15 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.158814:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6512d expref: 15 pid: 14381 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100613.158828:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad535c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126294784:192.168.201.18@tcp:104: 00000100:00100000:1.0:1790100613.158912:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67a943a300 going to sleep for 11 seconds 00000100:00100000:3.0:1790100613.163521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100613.163660:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad535c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126294784:192.168.201.18@tcp:104: 00010000:00010000:1.0:1790100613.163691:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100613.164299:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109539328 00000100:00100000:0.0:1790100613.164308:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109539328 00010000:00010000:0.0:1790100613.164345:0:14369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6512d expref: 16 pid: 14381 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100613.164493:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 15 00000100:00100000:0.0:1790100613.164503:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e88987-66d0-4240-a27c-27ca03f877ad+16:2357:x1877056109539328:12345-192.168.201.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790100613.164520:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790100613.164528:0:14369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6512d expref: 16 pid: 14381 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.164540:0:14369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6512d expref: 16 pid: 14381 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.164563:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143600/0x31a8f3fdeeefe53d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc6512d expref: 16 pid: 14381 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.164578:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4300) 00010000:00010000:0.0:1790100613.164582:0:14369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.164592:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.164598:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.164678:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790100613.164732:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e88987-66d0-4240-a27c-27ca03f877ad+15:2357:x1877056109539328:12345-192.168.201.18@tcp:103:ldlm_bl.0 Request processed in 229us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100613.164753:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 15 00010000:00010000:3.0:1790100613.165078:0:14382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.165101:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100613.165305:0:14382:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1790100613.165469:0:14382:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1790100613.165519:0:14382:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1790100613.165598:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf3fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14382:1877056126294912:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790100613.165726:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100613.165772:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ad960000 going to sleep for 11 seconds 00000100:00100000:2.0:1790100613.165983:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126294912 00000100:00100000:2.0:1790100613.165990:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126294912 00000100:00100000:2.0:1790100613.166033:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100613.166042:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14382:x1877056126294912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790100613.166120:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bb9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14382:x1877056126294912:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100613.166128:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790100613.166171:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf3fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14382:1877056126294912:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1790100613.167004:0:14382:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1790100613.167071:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14382:1877056126295040:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790100613.167124:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100613.167148:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ae80a540 going to sleep for 11 seconds 00000100:00100000:2.0:1790100613.167167:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126295040 00000100:00100000:2.0:1790100613.167172:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126295040 00000100:00100000:2.0:1790100613.167200:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790100613.167207:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14382:x1877056126295040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790100613.170702:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14382:x1877056126295040:12345-0@lo:1000:mdt00_001.0 Request processed in 3485us (3566us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790100613.170732:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790100613.173248:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14382:1877056126295040:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790100613.173455:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173531:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173539:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173546:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100613.173551:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173560:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173579:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4300) 00010000:00010000:2.0:1790100613.173582:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100613.173587:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173593:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13800/0x31a8f3fdeeefe575 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173760:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173768:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173773:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173796:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100613.173800:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173806:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173814:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:2.0:1790100613.173817:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790100613.173824:0:14382:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe4d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65111 expref: 18 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173835:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe4d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65111 expref: 18 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173844:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65111 expref: 18 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.173973:0:14382:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13200/0x31a8f3fdeeefe4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.18@tcp remote: 0x7e7a2353edc65111 expref: 18 pid: 14381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100613.173988:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67ad87c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126295168:192.168.201.18@tcp:105: 00000100:00100000:2.0:1790100613.174146:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67ae80a840 going to sleep for 11 seconds 00000100:00100000:0.0:1790100613.178855:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100613.178973:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67ad87c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14382:1877056126295168:192.168.201.18@tcp:105: 00010000:00010000:2.0:1790100613.179000:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179032:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143400/0x31a8f3fdeeefe4cd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14383 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179064:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179078:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179088:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179099:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179106:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179112:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179118:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6785143e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100613.179122:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179129:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179140:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:2.0:1790100613.179144:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790100613.179147:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179163:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6785143e00/0x31a8f3fdeeefe57c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179173:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179179:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179185:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179190:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1790100613.179193:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179198:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179208:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6799df4b00) 00010000:00010000:2.0:1790100613.179210:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790100613.179213:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.179218:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67b5e13400/0x31a8f3fdeeefe56e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100613.179507:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e88987-66d0-4240-a27c-27ca03f877ad+18:14503:x1877056109539200:12345-192.168.201.18@tcp:57:lhsmtool_posix.0 Request processed in 21197us (21520us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1790100613.179517:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 53 00000020:00080000:2.0:1790100613.179530:0:14382:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790100613.182177:0:14416:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790100613.182187:0:14416:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790100613.182218:0:14416:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790100613.182234:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790100613.183021:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109539456 00000100:00100000:3.0:1790100613.183033:0:14385:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109539456 00000100:00100000:1.0:1790100613.183248:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100613.183319:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109539712 00000100:00100000:0.0:1790100613.183323:0:14384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109539712 00000100:00100000:0.0:1790100613.183374:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 10 00000100:00100000:0.0:1790100613.183384:0:14384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e88987-66d0-4240-a27c-27ca03f877ad+19:14503:x1877056109539712:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790100613.184095:0:14384:0:(mdd_object.c:4178:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790100613.184206:0:14384:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1790100613.184262:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.184280:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.184292:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.184301:0:14384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.184307:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.184315:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.184510:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790100613.184637:0:14384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e88987-66d0-4240-a27c-27ca03f877ad+21:14503:x1877056109539712:12345-192.168.201.18@tcp:35:lhsmtool_posix.0 Request processed in 1252us (1390us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1790100613.184646:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 10 00000020:00080000:0.0:1790100613.184652:0:14384:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790100613.185891:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 11 00000100:00100000:2.0:1790100613.185904:0:14385:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67913e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+20:14502:x1877056109539456:12345-192.168.201.18@tcp:49:dd.0 00000100:00100000:2.0:1790100613.186034:0:14385:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67913e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e88987-66d0-4240-a27c-27ca03f877ad+20:14502:x1877056109539456:12345-192.168.201.18@tcp:49:dd.0 Request processed in 132us (7188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100613.186041:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 11 00010000:00010000:3.0:1790100613.187168:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790100613.187179:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.187189:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818c00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100613.187194:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.187203:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.187219:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6799df4300) 00010000:00010000:3.0:1790100613.187232:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790100613.187237:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.187244:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d67ad818c00/0x31a8f3fdeeefe583 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.194917:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100613.194925:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100613.194928:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790100613.399732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100613.405703:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:1.0:1790100613.419422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:3.0:1790100613.419982:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109539840 00000100:00100000:3.0:1790100613.419994:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109539840 00000100:00100000:3.0:1790100613.420063:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109539968 00000100:00100000:3.0:1790100613.420067:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109539968 00000100:00100000:3.0:1790100613.420088:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:3.0:1790100613.420098:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e88987-66d0-4240-a27c-27ca03f877ad+8:2360:x1877056109539840:12345-192.168.201.18@tcp:4:dd.0 00002000:00010000:3.0:1790100613.420150:0:15069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6ab2c483, atime: 0x6ab2c482, ctime: 0x6ab2c483, blocks: 0x1 00010000:00010000:3.0:1790100613.420161:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.420178:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1790100613.420182:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.420189:0:15069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.420203:0:15069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100613.427844:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1790100613.427861:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1790100613.431710:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109540096 00000100:00100000:2.0:1790100613.431727:0:15070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109540096 00000100:00100000:3.0:1790100613.432591:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 1 00000100:00100000:3.0:1790100613.432605:0:16610:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:18e88987-66d0-4240-a27c-27ca03f877ad+10:2360:x1877056109539968:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:3.0:1790100613.432702:0:16610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.432721:0:16610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790100613.432732:0:16610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.432738:0:16610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.432754:0:16610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.484210:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790100613.648813:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:0.0:1790100613.648921:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1790100613.649147:0:15069:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1790100613.649152:0:15069:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790100611 -> 1790100612 00002000:00010000:2.0:1790100613.649156:0:15069:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1790100613.649172:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.649186:0:15069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.649196:0:15069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.649204:0:15069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fe000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100613.649210:0:15069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.649249:0:15069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.649271:0:15069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100613.649279:0:15069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008016c611/0x31a8f3fdeeefe58a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100613.652540:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e88987-66d0-4240-a27c-27ca03f877ad+10:2360:x1877056109539840:12345-192.168.201.18@tcp:4:dd.0 Request processed in 232430us (252807us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1790100613.652558:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 0 00000100:00100000:2.0:1790100613.652765:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:2.0:1790100613.652792:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e88987-66d0-4240-a27c-27ca03f877ad+9:2360:x1877056109540096:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:3.0:1790100613.654241:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.654267:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.654273:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.654279:0:15069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.654295:0:15069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790100613.739971:0:16610:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1790100613.739983:0:16610:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1790100613.740019:0:16610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.740033:0:16610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.740043:0:16610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.740051:0:16610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fea00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100613.740057:0:16610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.740067:0:16610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.740089:0:16610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100613.740097:0:16610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fa97f8f/0x31a8f3fdeeefe591 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100613.740196:0:16610:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:18e88987-66d0-4240-a27c-27ca03f877ad+11:2360:x1877056109539968:12345-192.168.201.18@tcp:4:dd.0 Request processed in 307589us (334499us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790100613.740221:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 1 00000001:00080000:1.0:1790100613.740268:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1790100613.772416:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1790100613.772656:0:15069:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1790100613.772674:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.772688:0:15069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.772698:0:15069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.772705:0:15069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fec00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:0.0:1790100613.772710:0:15069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.772719:0:15069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.772738:0:15069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.772756:0:15069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe598 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100613.772850:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e88987-66d0-4240-a27c-27ca03f877ad+5:2360:x1877056109540096:12345-192.168.201.18@tcp:4:dd.0 Request processed in 120071us (353433us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1790100613.772864:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 2 00000100:00100000:2.0:1790100613.783007:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100613.783051:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100613.783080:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100613.783108:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100613.783131:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:0.0:1790100613.783220:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109540224 00000100:00100000:0.0:1790100613.783229:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109540224 00000100:00100000:0.0:1790100613.783296:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109540352 00000100:00100000:0.0:1790100613.783300:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109540352 00000100:00100000:0.0:1790100613.783312:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109540608 00000100:00100000:0.0:1790100613.783314:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109540608 00000100:00100000:0.0:1790100613.783325:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109540480 00000100:00100000:0.0:1790100613.783327:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109540480 00000100:00100000:0.0:1790100613.783337:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109540736 00000100:00100000:0.0:1790100613.783339:0:15071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109540736 00000100:00100000:0.0:1790100613.783353:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 3 00000100:00100000:0.0:1790100613.783362:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:18e88987-66d0-4240-a27c-27ca03f877ad+9:2357:x1877056109540224:12345-192.168.201.18@tcp:4:dd.0 00002000:00010000:0.0:1790100613.783418:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6ab2c484, atime: 0x6ab2c482, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1790100613.783427:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.783445:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1790100613.783450:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100613.783457:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.783492:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100613.783713:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:0.0:1790100613.783722:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e88987-66d0-4240-a27c-27ca03f877ad+10:2357:x1877056109540352:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:0.0:1790100613.783740:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.783750:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100613.783753:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790100613.783757:0:15069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790100613.783766:0:15069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790100613.862038:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100613.862060:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126295296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790100613.862375:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100613.862565:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126295424:0@lo:400:kworker.0 00000100:00100000:0.0:1790100613.862598:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100613.862639:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126295936:0@lo:400:kworker.0 00000100:00100000:0.0:1790100613.862665:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100613.862682:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790100613.862703:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126295808:0@lo:400:kworker.0 00000100:00100000:0.0:1790100613.862728:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790100613.862793:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126295424 00000100:00100000:0.0:1790100613.862800:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126295424 00000100:00100000:0.0:1790100613.862860:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790100613.862869:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3312:x1877056126295424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100613.862915:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8+19:3312:x1877056126295424:12345-0@lo:400:kworker.0 Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100613.862922:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1790100613.862965:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c14c9b5f-8de7-4b86-b0e7-559cbab51fe8:3312:1877056126295424:0@lo:400:kworker.0 00000100:00100000:1.0:1790100613.866739:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6784e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126295552:0@lo:400:kworker.0 00000100:00100000:1.0:1790100613.866859:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790100613.866928:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790100613.866936:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67bf4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126295680:0@lo:400:kworker.0 00000100:00100000:1.0:1790100613.866966:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790100613.867922:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126295296 00000100:00100000:3.0:1790100613.867938:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126295296 00000100:00100000:3.0:1790100613.868016:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790100613.868030:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6784e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126295296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790100613.868075:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790100613.868369:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6784e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1877056126295296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 342us (5995us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100613.868376:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126295936 00000100:00100000:3.0:1790100613.868377:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790100613.868380:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126295936 00000100:00100000:3.0:1790100613.868411:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126295808 00000100:00100000:3.0:1790100613.868415:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126295808 00000100:00100000:2.0:1790100613.868419:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126295680 00000100:00100000:2.0:1790100613.868421:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126295680 00000100:00100000:2.0:1790100613.868435:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790100613.868441:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126295936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100613.868486:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1877056126295936:12345-0@lo:400:kworker.0 Request processed in 44us (5819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100613.868493:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790100613.868506:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790100613.868512:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126295680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790100613.868519:0:14383:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790100613.868526:0:14383:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790100613.868545:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1877056126295680:12345-0@lo:400:kworker.0 Request processed in 33us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100613.868551:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790100613.868562:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100613.868567:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126295808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790100613.868592:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1877056126295808:12345-0@lo:400:kworker.0 Request processed in 25us (5863us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100613.868597:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790100613.868669:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1877056126295680:0@lo:400:kworker.0 00000100:00100000:3.0:1790100613.868676:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1877056126295808:0@lo:400:kworker.0 00000100:00100000:3.0:1790100613.868690:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67bf4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1877056126295936:0@lo:400:kworker.0 00000100:00100000:3.0:1790100613.868705:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1877056126295296:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1790100613.868754:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790100613.868766:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790100613.868896:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126295552 00000100:00100000:0.0:1790100613.868907:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126295552 00000100:00100000:0.0:1790100613.868991:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790100613.869008:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126295552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790100613.869578:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1877056126295552:12345-0@lo:400:kworker.0 Request processed in 573us (2714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790100613.869590:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790100613.869691:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1790100613.869702:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d67ad87e680, transno 8589934595 00000004:00080000:2.0:1790100613.869720:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1790100613.869741:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6784e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1877056126295552:0@lo:400:kworker.0 00002000:00010000:3.0:1790100613.932954:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:3.0:1790100613.932964:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1790100613.932979:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.932992:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.933001:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.933008:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad818400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:3.0:1790100613.933013:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.933021:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.933043:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.933050:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef020ba6/0x31a8f3fdeeefe59f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790100613.933195:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:18e88987-66d0-4240-a27c-27ca03f877ad+14:2357:x1877056109540224:12345-192.168.201.18@tcp:4:dd.0 Request processed in 149828us (150194us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1790100613.933206:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 3 00000001:00080000:1.0:1790100613.933281:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000100:00100000:3.0:1790100613.933386:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:3.0:1790100613.933402:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:18e88987-66d0-4240-a27c-27ca03f877ad+11:2358:x1877056109540608:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:3.0:1790100613.933436:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.933450:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.933455:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790100613.933461:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790100613.933473:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790100614.044201:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:1.0:1790100614.062855:0:15069:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:1.0:1790100614.062868:0:15069:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790100612 -> 1790100613 00002000:00010000:1.0:1790100614.062871:0:15069:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1790100613 00002000:00010000:1.0:1790100614.062874:0:15069:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1790100614.063290:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.063307:0:15069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.063318:0:15069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.063326:0:15069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67ad819000 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100614.063331:0:15069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.063340:0:15069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.063387:0:15069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.063756:0:15069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c94c0959/0x31a8f3fdeeefe5a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100614.063858:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e88987-66d0-4240-a27c-27ca03f877ad+11:2357:x1877056109540352:12345-192.168.201.18@tcp:4:dd.0 Request processed in 280132us (280800us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1790100614.063870:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 4 00000100:00100000:1.0:1790100614.064785:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 6 00000100:00100000:1.0:1790100614.064816:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e88987-66d0-4240-a27c-27ca03f877ad+10:2358:x1877056109540480:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:1.0:1790100614.064858:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.064871:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100614.064875:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100614.064881:0:15069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.064893:0:15069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790100614.167799:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00010000:00010000:1.0:1790100614.168344:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.168377:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.168386:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.168393:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67c21fec00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100614.168399:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.168409:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.168444:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.168452:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d8c8419/0x31a8f3fdeeefe5ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100614.168561:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:18e88987-66d0-4240-a27c-27ca03f877ad+10:2358:x1877056109540608:12345-192.168.201.18@tcp:4:dd.0 Request processed in 235160us (385474us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790100614.168570:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 5 00000100:00100000:1.0:1790100614.168604:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 7 00000100:00100000:1.0:1790100614.168657:0:15071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:18e88987-66d0-4240-a27c-27ca03f877ad+9:2358:x1877056109540736:12345-192.168.201.18@tcp:4:dd.0 00010000:00010000:1.0:1790100614.168693:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.168713:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100614.168718:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790100614.168725:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.168738:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100614.192837:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100614.192880:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100614.192912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100614.192942:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100614.192966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100614.192998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.18@tcp (source: 12345-192.168.201.18@tcp) 00000100:00100000:2.0:1790100614.193047:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109541120 00000100:00100000:2.0:1790100614.193058:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109541120 00000100:00100000:2.0:1790100614.193119:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109541376 00000100:00100000:2.0:1790100614.193122:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109541376 00000100:00100000:2.0:1790100614.193141:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109541504 00000100:00100000:2.0:1790100614.193145:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109541504 00000100:00100000:2.0:1790100614.193167:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1790100614.193178:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e88987-66d0-4240-a27c-27ca03f877ad+5:2359:x1877056109541120:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100614.193329:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e88987-66d0-4240-a27c-27ca03f877ad+5:2359:x1877056109541120:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 90us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100614.193338:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 21 00000100:00100000:2.0:1790100614.193355:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:2.0:1790100614.193362:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5745a62d-b161-4567-a7f5-21880928c2da+5:2359:x1877056109541376:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100614.193386:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ad87f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5745a62d-b161-4567-a7f5-21880928c2da+5:2359:x1877056109541376:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100614.193392:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 22 00000100:00100000:2.0:1790100614.193403:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1790100614.193408:0:15066:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5745a62d-b161-4567-a7f5-21880928c2da+5:2359:x1877056109541504:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100614.193503:0:15066:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5745a62d-b161-4567-a7f5-21880928c2da+5:2359:x1877056109541504:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 94us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100614.193509:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 23 00000100:00100000:2.0:1790100614.193531:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109540992 00000100:00100000:2.0:1790100614.193535:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109540992 00000100:00100000:3.0:1790100614.193556:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109540864 00000100:00100000:3.0:1790100614.193563:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109540864 00000100:00100000:2.0:1790100614.193576:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056109541248 00000100:00100000:2.0:1790100614.193581:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056109541248 00000100:00100000:3.0:1790100614.193638:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:2.0:1790100614.193642:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:3.0:1790100614.193651:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67ae671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:2359:x1877056109540864:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100614.193656:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+20:2359:x1877056109540992:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:3.0:1790100614.193690:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67ae671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e402f9-88fa-42cc-ac17-8cdf00c9f9ee+13:2359:x1877056109540864:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 41us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1790100614.193697:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 124 00000100:00100000:2.0:1790100614.193708:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e88987-66d0-4240-a27c-27ca03f877ad+20:2359:x1877056109540992:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 54us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100614.193717:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 33 00000100:00100000:2.0:1790100614.193735:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00100000:2.0:1790100614.193744:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66839caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+6:2359:x1877056109541248:12345-192.168.201.18@tcp:400:kworker.0 00000100:00100000:2.0:1790100614.193770:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66839caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5745a62d-b161-4567-a7f5-21880928c2da+6:2359:x1877056109541248:12345-192.168.201.18@tcp:400:kworker.0 Request processed in 29us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100614.193775:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 34 00000100:00080000:2.0:1790100614.193798:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790100614.193803:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790100614.193805:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1790100614.243053:0:15069:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1790100614.243063:0:15069:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1790100614.243078:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100614.243093:0:15069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100614.243102:0:15069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100614.243109:0:15069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13a00 already unused, calling callback (ffffffffc1718900) 00010000:00010000:2.0:1790100614.243114:0:15069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100614.243140:0:15069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100614.243162:0:15069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790100614.243170:0:15069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096d40837/0x31a8f3fdeeefe5b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790100614.243275:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6787773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e88987-66d0-4240-a27c-27ca03f877ad+11:2358:x1877056109540480:12345-192.168.201.18@tcp:4:dd.0 Request processed in 178470us (460161us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790100614.243285:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 6 00000001:00080000:2.0:1790100614.243320:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:3.0:1790100614.335840:0:6714:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:1.0:1790100614.336357:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1790100614.336376:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.336512:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.336525:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.336533:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d67b5e13400 already unused, calling callback (ffffffffc1718900) 00010000:00010000:1.0:1790100614.336538:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.336548:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.336569:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790100614.336679:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd8c39cc/0x31a8f3fdeeefe5bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790100614.336844:0:15071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:18e88987-66d0-4240-a27c-27ca03f877ad+5:2358:x1877056109540736:12345-192.168.201.18@tcp:4:dd.0 Request processed in 168228us (553706us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1790100614.336855:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.18@tcp, seq: 7 00010000:00010000:1.0:1790100614.501877:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790100615.526776:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790100616.423105:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790100616.423133:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126296064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790100616.423218:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790100616.423847:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877056126296064 00000100:00100000:2.0:1790100616.423856:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877056126296064 00000100:00100000:2.0:1790100616.423926:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790100616.423936:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67bf4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126296064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790100616.423972:0:15068:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1790100616.424038:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67bf4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1877056126296064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1790100616.424046:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1790100616.424135:0:14377:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790100616.424187:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66839cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1877056126296064:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1790100616.441788:0:16651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1790100616.560593:0:15991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790100617.574000:0:14371:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29227 lines, 29227 kept, 0 dropped, 0 bad.